Sep 23 00:04:04 devstack cinder-volume[75399]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:04:04 devstack cinder-volume[75399]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:04:04 devstack cinder-volume[75399]: we strongly recommend against using it for new projects.
Sep 23 00:04:04 devstack cinder-volume[75399]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:04:04 devstack cinder-volume[75399]: framework.  For more detail see
Sep 23 00:04:04 devstack cinder-volume[75399]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:04:04 devstack cinder-volume[75399]:   import eventlet  # noqa
Sep 23 00:04:06 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:04:06 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:04:06 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:04:07 devstack cinder-volume[75399]: INFO dbcounter [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Registered counter for database cinder
Sep 23 00:04:07 devstack cinder-volume[75399]: DEBUG oslo_db.sqlalchemy.engines [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG dbcounter [-] [75399] Writer thread running {{(pid=75399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.rpc [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.rpc [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG oslo_db.sqlalchemy.engines [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.volume.manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Determined volume DB was empty at startup.
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG cinder.volume.manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75399) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.volume.manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 00:04:08 devstack cinder-volume[75399]: WARNING stevedore.named [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:04:08 devstack cinder-volume[75399]: WARNING castellan.key_manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:04:08 devstack cinder-volume[75399]: WARNING cinder.keymgr.conf_key_mgr [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG cinder.volume.drivers.lvm [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75399) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG oslo_concurrency.processutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG oslo_concurrency.processutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.496s {{(pid=75399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:08 devstack cinder-volume[75399]: DEBUG oslo_db.sqlalchemy.engines [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.rpc [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 23 00:04:08 devstack cinder-volume[75399]: INFO cinder.rpc [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 23 00:04:09 devstack cinder-volume[75399]: WARNING stevedore.named [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:04:09 devstack cinder-volume[75399]: WARNING castellan.key_manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:04:09 devstack cinder-volume[75399]: INFO cinder.volume.manager [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_db.sqlalchemy.engines [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:04:09 devstack cinder-volume[75399]: INFO oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Starting 1 workers
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Started child 75566 {{(pid=75399) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Full set of CONF: {{(pid=75399) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] ******************************************************************************** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Configuration options gathered from: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] ================================================================================ {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] allow_availability_zone_fallback = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] allow_compression_on_image_upload = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75566]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] allowed_direct_url_schemes     = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] api_rate_limit                 = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] auth_strategy                  = keystone {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] az_cache_duration              = 3600 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_availability_zone      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_host                   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_name                   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_stats_polling_interval = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backup_api_class               = cinder.backup.api.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backup_name_template           = backup-%s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backup_use_same_host           = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backup_use_temp_snapshot       = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] chap_password                  = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] chap_username                  =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_internal_tenant_project_id = e9b60effce104786b9893ebae16a0216 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_internal_tenant_user_id = f8e4721e67b742018053952b65b613ee {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cloned_volume_same_az          = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cluster                        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] compression_format             = gzip {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] config_dir                     = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] config_source                  = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] control_exchange               = openstack {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] debug                          = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] default_availability_zone      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] default_group_type             = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] default_volume_type            = lvmdriver-1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] deployment_max_gigabytes       = -1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] disk_geometry                  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_client_cert             = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_client_cert_key         = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_data_namespace          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_ssl_cert_path           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_ssl_cert_verify         = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] driver_use_ssl                 = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] enable_force_upload            = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] enable_new_services            = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] enable_unsupported_driver      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] enforce_multipath_for_image_xfer = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] filter_function                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_api_insecure            = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_api_servers             = ['http://192.168.122.80/image'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_api_ssl_compression     = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_ca_certificates_file    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_certfile                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_keyfile                 = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_num_retries             = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance_request_timeout         = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] goodness_function              = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] graceful_shutdown_timeout      = 5 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] group_api_class                = cinder.group.api.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] host                           = devstack {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_compress_on_upload       = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_conversion_address_space_limit = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_conversion_cpu_limit     = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_conversion_disable       = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_introspection_address_space_limit = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_introspection_cpu_limit  = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75566]: INFO cinder.volume.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_upload_use_cinder_backend = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_upload_use_internal_tenant = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_volume_cache_enabled     = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_volume_cache_max_count   = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] image_volume_cache_max_size_gb = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] init_host_max_objects_retrieval = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iscsi_target_flags             =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iscsi_write_cache              = on {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iser_helper                    = tgtadm {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iser_ip_address                = 192.168.122.80 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iser_port                      = 3260 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_color                      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_config_append              = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_dir                        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_file                       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_options                    = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_rotate_interval            = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_rotate_interval_type       = days {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] log_rotation_type              = none {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] max_age                        = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] max_logfile_count              = 30 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] max_logfile_size_mb            = 200 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] max_over_subscription_ratio    = 20.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] message_reap_interval          = 86400 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] message_ttl                    = 2592000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] migration_create_volume_timeout_secs = 300 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] monkey_patch                   = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] monkey_patch_modules           = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] my_ip                          = 192.168.122.80 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] no_snapshot_gb_quota           = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] num_iser_scan_tries            = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] num_shell_tries                = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] num_volume_device_scan_tries   = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] nvmeof_conn_info_version       = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] nvmet_ns_id                    = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] nvmet_port_id                  = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_max_limit                = 1000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_ext_list          = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_listen_port       = 8776 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_use_ssl           = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] osapi_volume_workers           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] per_volume_size_limit          = -1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] periodic_fuzzy_delay           = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] periodic_interval              = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] public_endpoint                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] publish_errors                 = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_backup_gigabytes         = 1000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_backups                  = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_gigabytes                = 1000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_groups                   = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_snapshots                = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] quota_volumes                  = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] rate_limit_burst               = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] rate_limit_except_level        = CRITICAL {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] rate_limit_interval            = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] reinit_driver_count            = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] replication_device             = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] report_discard_supported       = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] report_interval                = 120 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] reservation_clean_interval     = 86400 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] reservation_expire             = 86400 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] reserved_image_namespaces      = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] reserved_percentage            = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] rpc_response_timeout           = 120 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] run_external_periodic_tasks    = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] scst_target_driver             = iscsi {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] scst_target_iqn_name           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_down_time              = 720 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] shell_completion               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack sudo[75570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] snapshot_name_template         = snapshot-%s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] snapshot_same_host             = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack sudo[75570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] split_loggers                  = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] state_path                     = /opt/stack/data/cinder {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] storage_availability_zone      = nova {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] storage_protocol               = iSCSI {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] syslog_log_facility            = LOG_USER {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_helper                  = lioadm {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_ip_address              = 192.168.122.80 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_port                    = 3260 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_protocol                = iscsi {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] target_secondary_ip_addresses  = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] trace_flags                    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] transport_url                  = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] until_refresh                  = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_chap_auth                  = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_default_quota_class        = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_journal                    = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_json                       = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_multipath_for_image_xfer   = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_stderr                     = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] use_syslog                     = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] verify_glance_signatures       = enabled {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_api_class               = cinder.volume.api.API {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_backend_name            = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_clear                   = zero {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_clear_ionice            = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_clear_size              = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_copy_bps_limit          = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_dd_blocksize            = 1M {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_name_template           = volume-%s {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_service_inithost_offload = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volume_usage_audit_period      = month {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] zoning_mode                    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_concurrency.disable_process_locking = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.auth_section = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.auth_type   = password {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.auth_version = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.cache       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.certfile    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.include_service_catalog = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.insecure    = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.interface   = public {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.keyfile     = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_password = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcache_username = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.region_name = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.service_type = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.backend                  = dogpile.cache.null {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.backend_argument         = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.backend_expiration_time  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.config_prefix            = cache.oslo {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.debug_cache_backend      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.enable_retry_client      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.enable_socket_keepalive  = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.enabled                  = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.expiration_time          = 600 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.hashclient_retry_attempts = 2 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_dead_retry      = 300 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_sasl_enabled    = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.password                 = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.proxies                  = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.redis_db                 = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.redis_server             = localhost:6379 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.retry_attempts           = 2 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.retry_delay              = 0.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.socket_keepalive_count   = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.socket_keepalive_idle    = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.socket_keepalive_interval = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.socket_timeout           = 1.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.tls_allowed_ciphers      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.tls_cafile               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.tls_certfile             = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.tls_enabled              = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.tls_keyfile              = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cache.username                 = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] coordination.backend_url       = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.asyncio_connection    = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.asyncio_slave_connection = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.backend               = sqlalchemy {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.connection            = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.connection_debug      = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.connection_parameters =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.connection_recycle_time = 3600 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.connection_trace      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.db_inc_retry_interval = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.db_max_retries        = 20 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.db_max_retry_interval = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.db_retry_interval     = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.max_overflow          = 50 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.max_pool_size         = 5 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.max_retries           = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.mysql_wsrep_sync_wait = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.pool_timeout          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.retry_interval        = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.slave_connection      = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.sqlite_synchronous    = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.synchronous_reader    = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] database.use_db_reconnect      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_tracing.insecure = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.connection_string     = messaging:// {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.enabled               = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.es_doc_type           = notification {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.es_scroll_size        = 10000 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.es_scroll_time        = 2m {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.filter_error_trace    = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.hmac_keys             = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.sentinel_service_name = mymaster {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.socket_timeout        = 0.1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.trace_requests        = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler.trace_sqlalchemy      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler_jaeger.process_tags   = {} {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler_jaeger.service_name_prefix = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] profiler_otlp.service_name_prefix = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.enforce_new_defaults = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.policy_default_rule = default {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.group          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.helper_command = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] privsep_osbrick.user           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.group         = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.helper_command = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] cinder_sys_admin.user          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.auth_section      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.auth_type         = password {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.cafile            = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.certfile          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.collect_timing    = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.insecure          = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.keyfile           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.send_service_user_token = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.split_loggers     = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.timeout           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.tls_ciphers       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] service_user.tls_min_version   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.auth_section            = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.auth_type               = password {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.certfile                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.collect_timing          = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.insecure                = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.keyfile                 = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.region_name             = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.split_loggers           = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.timeout                 = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.tls_ciphers             = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] glance.tls_min_version         = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.backend_availability_zone = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.chap_password = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.chap_username =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.disk_geometry = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_client_cert = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_client_cert_key = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_data_namespace = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.driver_use_ssl = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.extra_capabilities = {} {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.filter_function = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.goodness_function = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iscsi_target_flags =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iscsi_write_cache = on {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iser_port     = 3260 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.lvm_share_target = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.lvm_type      = auto {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.num_shell_tries = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.replication_device = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.report_discard_supported = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.reserved_percentage = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_helper = tgtadm {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_port   = 3260 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_protocol = iscsi {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.trace_flags   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.unique_fqdn_network = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.use_chap_auth = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_backend_name = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_clear  = zero {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_clear_ionice = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_clear_size = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_reports.file_event_handler = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_reports.log_dir           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.backend_host       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.chap_password      = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.chap_username      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.disk_geometry      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_client_cert = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.extra_capabilities = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.filter_function    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.goodness_function  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iser_helper        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iser_port          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.lvm_type           = auto {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.replication_device = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.report_discard_supported = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.reserved_percentage = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.scst_target_driver = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.storage_protocol   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_ip_address  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_port        = 3260 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.trace_flags        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_clear       = zero {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] lvmdriver-1.volumes_dir        = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_notifications.driver = [] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_notifications.retry = -1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] key_manager.fixed_key          = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.barbican_api_version  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.barbican_endpoint     = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.barbican_endpoint_type = public {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.barbican_region_name  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.cafile                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.certfile              = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.collect_timing        = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.insecure              = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.keyfile               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.number_of_retries     = 60 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.retry_delay           = 1 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.send_service_user_token = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.split_loggers         = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.timeout               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.tls_ciphers           = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.tls_min_version       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.verify_ssl            = True {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican.verify_ssl_path       = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.auth_section = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.auth_type = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.cafile   = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.certfile = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.collect_timing = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.insecure = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.keyfile  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.split_loggers = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.timeout  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.tls_ciphers = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] barbican_service_user.tls_min_version = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.approle_role_id          = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.approle_secret_id        = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.auth_method              = approle {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.auth_path                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.kv_mountpoint            = secret {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.kv_path                  = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.kv_version               = 2 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.namespace                = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.root_token_id            = **** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.ssl_ca_crt_file          = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.timeout                  = 60.0 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.token_file               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.token_role               = None {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.use_ssl                  = False {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:04:09 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] ******************************************************************************** {{(pid=75399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:04:09 devstack sudo[75570]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.410s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:09 devstack sudo[75730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:09 devstack sudo[75730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:09 devstack sudo[75730]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:04:09 devstack cinder-volume[75566]: INFO cinder.brick.local_dev.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 23 00:04:09 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:10 devstack sudo[75816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:10 devstack sudo[75816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:10 devstack sudo[75816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG cinder.brick.local_dev.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75566) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:10 devstack sudo[75911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:10 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:10 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.550s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:10 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:10 devstack sudo[76100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:10 devstack sudo[76100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:11 devstack sudo[76100]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:11 devstack sudo[76180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 23 00:04:11 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:11 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.241s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:11 devstack sudo[76183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:11 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:11 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:11 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:11 devstack sudo[76266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:11 devstack sudo[76266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:12 devstack sudo[76266]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:12 devstack sudo[76274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:12 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:12 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:12 devstack sudo[76342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:12 devstack sudo[76342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:12 devstack sudo[76342]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:12 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:12 devstack sudo[76362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:12 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:13 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:13 devstack cinder-volume[75566]: INFO cinder.volume.drivers.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:13 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:13 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:13 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:13 devstack sudo[76369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:13 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:13 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:13 devstack sudo[76372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:13 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:13 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:13 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:13 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:13 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:14 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:14 devstack sudo[76384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:14 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:14 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:14 devstack cinder-volume[75566]: INFO cinder.volume.driver [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG cinder.volume.driver [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75566) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_db.sqlalchemy.engines [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writer thread running {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG cinder.db.api [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Building query based on filter {{(pid=75566) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG cinder.image.image_utils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75566) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:04:14 devstack cinder-volume[75566]: INFO cinder.keymgr.migration [None req-084573bd-657e-4e34-aab5-77c5823f1ffc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:14 devstack sudo[76387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:14 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:14 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:14 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:14 devstack sudo[76392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:14 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:15 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:15 devstack sudo[76395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:15 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:15 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.234s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:15 devstack sudo[76399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:15 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:15 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG cinder.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Notifying Schedulers of capabilities ... {{(pid=75566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:04:15 devstack cinder-volume[75566]: INFO cinder.volume.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Driver initialization completed successfully.
Sep 23 00:04:15 devstack cinder-volume[75566]: INFO cinder.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Initiating service 2 cleanup
Sep 23 00:04:15 devstack cinder-volume[75566]: INFO cinder.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Service 2 cleanup completed.
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG cinder.service [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Creating RPC server for service cinder-volume {{(pid=75566) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG cinder.service [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75566) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:04:15 devstack cinder-volume[75566]: INFO cinder.volume.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:04:15 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:15 devstack sudo[76402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:04:15 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:16 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:16 devstack sudo[76405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:16 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:16 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:16 devstack sudo[76410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:04:16 devstack sudo[76410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:16 devstack sudo[76410]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:04:16 devstack sudo[76413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:04:16 devstack sudo[76413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:04:16 devstack sudo[76413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:04:16 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:04:16 devstack cinder-volume[75566]: INFO cinder.volume.manager [None req-d800aff6-26fa-4702-acec-21a735d5e3b4 None None] Driver post RPC initialization completed successfully.
Sep 23 00:04:19 devstack cinder-volume[75399]: DEBUG dbcounter [-] [75399] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:04:19 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager._thread_info {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:04:19 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread count: 6 {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:04:19 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread info: [<_MainThread(MainThread, started 127737009234048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127736898499712)>, <Thread(Thread-3 (stat_writer), started daemon 127736897267520)>, <Thread(Rabbit-heartbeat, started daemon 127736894395712)>, <Thread(Thread-5 (_runner), started daemon 127736894447872)>, <Thread(Thread-7 (_runner), started daemon 127736894594880)>] {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:04:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:04:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:05:19 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:05:19 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:05:19 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:19 devstack sudo[78445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:05:19 devstack sudo[78445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:20 devstack sudo[78445]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack sudo[78448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:20 devstack sudo[78448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:20 devstack sudo[78448]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack sudo[78451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:05:20 devstack sudo[78451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:20 devstack sudo[78451]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:05:20 devstack sudo[78454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:05:20 devstack sudo[78454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:05:21 devstack sudo[78454]: pam_unix(sudo:session): session closed for user root
Sep 23 00:05:21 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:05:21 devstack cinder-volume[75566]: DEBUG cinder.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Notifying Schedulers of capabilities ... {{(pid=75566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:05:21 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager._thread_info {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:05:21 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread count: 6 {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:05:21 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread info: [<_MainThread(MainThread, started 127737009234048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127736898499712)>, <Thread(Thread-3 (stat_writer), started daemon 127736897267520)>, <Thread(Rabbit-heartbeat, started daemon 127736894395712)>, <Thread(Thread-5 (_runner), started daemon 127736894447872)>, <Thread(Thread-7 (_runner), started daemon 127736894594880)>] {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:06:19 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:06:19 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:06:19 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:19 devstack sudo[81741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:06:19 devstack sudo[81741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:20 devstack sudo[81741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:20 devstack sudo[81744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:06:20 devstack sudo[81744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:20 devstack sudo[81744]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:20 devstack sudo[81786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:06:20 devstack sudo[81786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:20 devstack sudo[81786]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:06:20 devstack sudo[81791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:06:20 devstack sudo[81791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:06:20 devstack sudo[81791]: pam_unix(sudo:session): session closed for user root
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG cinder.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Notifying Schedulers of capabilities ... {{(pid=75566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager._thread_info {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread count: 6 {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:06:20 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread info: [<_MainThread(MainThread, started 127737009234048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127736898499712)>, <Thread(Thread-3 (stat_writer), started daemon 127736897267520)>, <Thread(Rabbit-heartbeat, started daemon 127736894395712)>, <Thread(Thread-5 (_runner), started daemon 127736894447872)>, <Thread(Thread-7 (_runner), started daemon 127736894594880)>] {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:06:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:SELECT=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:06:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:UPDATE=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:07:19 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:07:19 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:07:19 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:19 devstack sudo[83765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:07:19 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:20 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:20 devstack sudo[83777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:07:20 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:20 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:20 devstack sudo[83780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:07:20 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:20 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:07:20 devstack sudo[83802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:07:20 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:07:21 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root
Sep 23 00:07:21 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:07:21 devstack cinder-volume[75566]: DEBUG cinder.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Notifying Schedulers of capabilities ... {{(pid=75566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:08:19 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:08:19 devstack cinder-volume[75566]: DEBUG cinder.volume.drivers.lvm [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Updating volume stats {{(pid=75566) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 23 00:08:19 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:19 devstack sudo[84997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 00:08:19 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:20 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:20 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:08:20 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:20 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:20 devstack sudo[85006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 00:08:20 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:20 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:20 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:20 devstack sudo[85009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 00:08:20 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:21 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:21 devstack cinder-volume[75566]: DEBUG oslo_concurrency.processutils [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75566) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:21 devstack cinder-volume[75566]: DEBUG cinder.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Notifying Schedulers of capabilities ... {{(pid=75566) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:08:21 devstack cinder-volume[75566]: DEBUG oslo_service.periodic_task [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] Running periodic task VolumeManager._thread_info {{(pid=75566) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:08:21 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread count: 6 {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:08:21 devstack cinder-volume[75566]: DEBUG cinder.volume.manager [None req-85713ac5-9c08-465e-86ef-621165009fb6 None None] thread info: [<_MainThread(MainThread, started 127737009234048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127736898499712)>, <Thread(Thread-3 (stat_writer), started daemon 127736897267520)>, <Thread(Rabbit-heartbeat, started daemon 127736894395712)>, <Thread(Thread-5 (_runner), started daemon 127736894447872)>, <Thread(Thread-7 (_runner), started daemon 127736894594880)>] {{(pid=75566) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:08:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:SELECT=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:08:26 devstack cinder-volume[75566]: DEBUG dbcounter [-] [75566] Writing DB stats cinder:UPDATE=1 {{(pid=75566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:08:45 devstack cinder-volume[75399]: INFO oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Caught SIGTERM, stopping children
Sep 23 00:08:45 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Acquiring lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:08:45 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Acquired lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:08:45 devstack cinder-volume[75399]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Releasing lock "singleton_lock" {{(pid=75399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:08:45 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Stop services. {{(pid=75399) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 23 00:08:45 devstack cinder-volume[75399]: DEBUG oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Killing children. {{(pid=75399) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 23 00:08:45 devstack cinder-volume[75399]: INFO oslo_service.backend._eventlet.service [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Waiting on 1 children to exit
Sep 23 00:08:50 devstack cinder-volume[75566]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 23 00:08:50 devstack cinder-volume[85620]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:08:50 devstack cinder-volume[85620]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:08:50 devstack cinder-volume[85620]: we strongly recommend against using it for new projects.
Sep 23 00:08:50 devstack cinder-volume[85620]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:08:50 devstack cinder-volume[85620]: framework.  For more detail see
Sep 23 00:08:50 devstack cinder-volume[85620]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:08:50 devstack cinder-volume[85620]:   import eventlet  # noqa
Sep 23 00:08:50 devstack cinder-volume[75566]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Acquiring lock "singleton_lock" {{(pid=75566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:08:50 devstack cinder-volume[75566]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Acquired lock "singleton_lock" {{(pid=75566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:08:50 devstack cinder-volume[75566]: DEBUG oslo_concurrency.lockutils [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Releasing lock "singleton_lock" {{(pid=75566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:08:50 devstack cinder-volume[75566]: WARNING amqp [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:08:50 devstack cinder-volume[75566]: WARNING amqp [None req-322ad2cc-eeb1-4eb0-a5f9-826275c656e6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:08:52 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:08:52 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:08:52 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:08:53 devstack cinder-volume[85620]: INFO dbcounter [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Registered counter for database cinder
Sep 23 00:08:53 devstack cinder-volume[85620]: DEBUG oslo_db.sqlalchemy.engines [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85620) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG dbcounter [-] [85620] Writer thread running {{(pid=85620) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO cinder.rpc [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO cinder.rpc [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_db.sqlalchemy.engines [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85620) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO cinder.volume.manager [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Determined volume DB was empty at startup.
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG cinder.volume.manager [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85620) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO cinder.volume.manager [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 00:08:54 devstack cinder-volume[85620]: WARNING stevedore.named [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:08:54 devstack cinder-volume[85620]: WARNING castellan.key_manager [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:08:54 devstack cinder-volume[85620]: WARNING cinder.keymgr.conf_key_mgr [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO cinder.volume.manager [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_db.sqlalchemy.engines [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85620) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:08:54 devstack cinder-volume[85620]: INFO oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Starting 1 workers
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Started child 85870 {{(pid=85620) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Full set of CONF: {{(pid=85620) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] ******************************************************************************** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Configuration options gathered from: {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] ================================================================================ {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] allow_availability_zone_fallback = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] allow_compression_on_image_upload = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] allowed_direct_url_schemes     = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] api_rate_limit                 = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] auth_strategy                  = keystone {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_availability_zone      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_host                   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_name                   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85870]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_stats_polling_interval = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backup_api_class               = cinder.backup.api.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backup_name_template           = backup-%s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backup_use_same_host           = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backup_use_temp_snapshot       = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] chap_password                  = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] chap_username                  =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_internal_tenant_project_id = e9b60effce104786b9893ebae16a0216 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_internal_tenant_user_id = f8e4721e67b742018053952b65b613ee {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cluster                        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] compression_format             = gzip {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] compute_api_class              = cinder.compute.nova.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] config_dir                     = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] config_source                  = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] control_exchange               = openstack {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] debug                          = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] default_availability_zone      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] default_group_type             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] default_volume_type            = QuobyteHD {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] deployment_max_gigabytes       = -1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] disk_geometry                  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_client_cert             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_client_cert_key         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_data_namespace          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_ssl_cert_path           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_ssl_cert_verify         = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] driver_use_ssl                 = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] enable_new_services            = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] enable_unsupported_driver      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] enabled_backends               = ['QuobyteHD'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] enforce_multipath_for_image_xfer = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] filter_function                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_api_insecure            = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_api_servers             = ['http://192.168.122.80/image'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_api_ssl_compression     = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_ca_certificates_file    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_catalog_info            = image:glance:publicURL {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_certfile                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_keyfile                 = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_num_retries             = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance_request_timeout         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] goodness_function              = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] graceful_shutdown_timeout      = 5 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] group_api_class                = cinder.group.api.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] host                           = devstack {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_compress_on_upload       = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_conversion_address_space_limit = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_conversion_cpu_limit     = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_conversion_disable       = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_introspection_address_space_limit = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_introspection_cpu_limit  = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_upload_use_cinder_backend = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_upload_use_internal_tenant = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_volume_cache_enabled     = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_volume_cache_max_count   = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] image_volume_cache_max_size_gb = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] init_host_max_objects_retrieval = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] instance_format                = [instance: %(uuid)s]  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iscsi_target_flags             =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iscsi_write_cache              = on {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iser_helper                    = tgtadm {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iser_ip_address                = 192.168.122.80 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iser_port                      = 3260 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_color                      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_config_append              = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_dir                        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_file                       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_options                    = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_rotate_interval            = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_rotate_interval_type       = days {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] log_rotation_type              = none {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] max_age                        = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] max_logfile_count              = 30 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] max_logfile_size_mb            = 200 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] max_over_subscription_ratio    = 20.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] message_reap_interval          = 86400 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] message_ttl                    = 2592000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] migration_create_volume_timeout_secs = 300 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] monkey_patch                   = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] monkey_patch_modules           = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] my_ip                          = 192.168.122.80 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] no_snapshot_gb_quota           = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] num_iser_scan_tries            = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] num_shell_tries                = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] num_volume_device_scan_tries   = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] nvmeof_conn_info_version       = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] nvmet_ns_id                    = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] nvmet_port_id                  = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_max_limit                = 1000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_ext_list          = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_listen_port       = 8776 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_use_ssl           = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] osapi_volume_workers           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] per_volume_size_limit          = -1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] periodic_fuzzy_delay           = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] periodic_interval              = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 23 00:08:54 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.remotefs [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85870) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] public_endpoint                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] publish_errors                 = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_backup_gigabytes         = 1000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_backups                  = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_gigabytes                = 1000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_groups                   = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_snapshots                = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] quota_volumes                  = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] rate_limit_burst               = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] rate_limit_except_level        = CRITICAL {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] rate_limit_interval            = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] reinit_driver_count            = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] replication_device             = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] report_discard_supported       = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] report_interval                = 120 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] reservation_clean_interval     = 86400 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] reservation_expire             = 86400 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] reserved_image_namespaces      = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] reserved_percentage            = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] rpc_response_timeout           = 120 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] run_external_periodic_tasks    = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] scst_target_driver             = iscsi {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] scst_target_iqn_name           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_down_time              = 720 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] shell_completion               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] snapshot_name_template         = snapshot-%s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] split_loggers                  = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] state_path                     = /opt/stack/data/cinder {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] storage_availability_zone      = nova {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] storage_protocol               = iSCSI {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] syslog_log_facility            = LOG_USER {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_helper                  = lioadm {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_ip_address              = 192.168.122.80 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_port                    = 3260 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_protocol                = iscsi {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] target_secondary_ip_addresses  = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] trace_flags                    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] transport_url                  = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] until_refresh                  = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_chap_auth                  = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_default_quota_class        = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_journal                    = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_json                       = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_multipath_for_image_xfer   = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_stderr                     = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] use_syslog                     = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] verify_glance_signatures       = enabled {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_api_class               = cinder.volume.api.API {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_backend_name            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_clear                   = zero {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_clear_ionice            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_clear_size              = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_copy_bps_limit          = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_dd_blocksize            = 1M {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_name_template           = volume-%s {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_service_inithost_offload = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volume_usage_audit_period      = month {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] zoning_mode                    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_concurrency.disable_process_locking = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.auth_section = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.auth_type   = password {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.auth_version = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.cache       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.certfile    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.delay_auth_decision = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.http_connect_timeout = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.include_service_catalog = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.insecure    = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.interface   = public {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.keyfile     = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_password = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcache_username = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.region_name = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.service_token_roles_required = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.service_type = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.token_cache_time = 300 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.backend                  = dogpile.cache.null {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.backend_argument         = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.backend_expiration_time  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.config_prefix            = cache.oslo {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.debug_cache_backend      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.enable_retry_client      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.enable_socket_keepalive  = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.enabled                  = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.expiration_time          = 600 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.hashclient_retry_attempts = 2 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_dead_retry      = 300 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_pool_maxsize    = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_sasl_enabled    = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.password                 = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.proxies                  = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.redis_db                 = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.redis_sentinel_service_name = mymaster {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.redis_server             = localhost:6379 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.retry_attempts           = 2 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.retry_delay              = 0.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.socket_keepalive_count   = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.socket_keepalive_idle    = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.socket_keepalive_interval = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.socket_timeout           = 1.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.tls_allowed_ciphers      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.tls_cafile               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.tls_certfile             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.tls_enabled              = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.tls_keyfile              = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cache.username                 = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] coordination.backend_url       = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.asyncio_connection    = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.asyncio_slave_connection = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.backend               = sqlalchemy {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.connection            = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.connection_debug      = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.connection_parameters =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.connection_recycle_time = 3600 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.connection_trace      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.db_inc_retry_interval = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.db_max_retries        = 20 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.db_max_retry_interval = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.db_retry_interval     = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.max_overflow          = 50 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.max_pool_size         = 5 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.max_retries           = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.mysql_wsrep_sync_wait = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.pool_timeout          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.retry_interval        = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.slave_connection      = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.sqlite_synchronous    = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.synchronous_reader    = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85870) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 23 00:08:54 devstack cinder-volume[85870]: WARNING cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 23 00:08:54 devstack cinder-volume[85870]: WARNING cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] database.use_db_reconnect      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_tracing.insecure = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Running cmd (subprocess): mount.quobyte {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.connection_string     = messaging:// {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.enabled               = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.es_doc_type           = notification {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.es_scroll_size        = 10000 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.es_scroll_time        = 2m {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.filter_error_trace    = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.hmac_keys             = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.sentinel_service_name = mymaster {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.socket_timeout        = 0.1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.trace_requests        = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler.trace_sqlalchemy      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler_jaeger.process_tags   = {} {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler_jaeger.service_name_prefix = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] profiler_otlp.service_name_prefix = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.enforce_new_defaults = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.policy_default_rule = default {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.policy_file        = policy.yaml {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.group          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.helper_command = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] privsep_osbrick.user           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.group         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.helper_command = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] cinder_sys_admin.user          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.auth_section      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.auth_type         = password {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.cafile            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.certfile          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.collect_timing    = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.insecure          = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.keyfile           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.send_service_user_token = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.split_loggers     = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.timeout           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.tls_ciphers       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] service_user.tls_min_version   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.auth_section            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.auth_type               = password {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.certfile                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.collect_timing          = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.insecure                = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.keyfile                 = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.region_name             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.split_loggers           = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.timeout                 = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.tls_ciphers             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] glance.tls_min_version         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.backend_availability_zone = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.chap_password = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.chap_username =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.disk_geometry = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_client_cert = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_client_cert_key = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_data_namespace = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.driver_use_ssl = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.enable_unsupported_driver = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.extra_capabilities = {} {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.filter_function = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.goodness_function = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iscsi_target_flags =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iscsi_write_cache = on {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iser_helper   = tgtadm {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iser_port     = 3260 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:54 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_host      =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_login     = admin {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_mount_options = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_password  = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_private_key =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_share_path =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.num_shell_tries = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.nvmet_port_id = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_client_cfg = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.quobyte_volume_url = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.replication_device = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.report_discard_supported = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.reserved_percentage = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.scst_target_driver = iscsi {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.scst_target_iqn_name = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.storage_protocol = iSCSI {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_helper = tgtadm {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_port   = 3260 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_protocol = iscsi {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.trace_flags   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.unique_fqdn_network = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.use_chap_auth = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_backend_name = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_clear  = zero {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_clear_ionice = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_clear_size = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_reports.file_event_handler = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_reports.log_dir           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.backend_availability_zone = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.backend_host         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.chap_password        = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.chap_username        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.chiscsi_conf         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.disk_geometry        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_client_cert   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_client_cert_key = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_data_namespace = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.driver_use_ssl       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.extra_capabilities   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.filter_function      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.goodness_function    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iser_helper          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iser_ip_address      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iser_port            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.iser_target_prefix   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_host             = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_login            = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_mount_options    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_password         = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_private_key      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_share_path       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_ssh_port         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack quobyte-client[85871]: Reading configuration file: /etc/quobyte/client.cfg
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.num_shell_tries      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.nvmet_port_id        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack quobyte-client[85871]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.replication_device   = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.report_discard_supported = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.reserved_percentage  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.scst_target_driver   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.storage_protocol     = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_helper        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_ip_address    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_port          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_prefix        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_protocol      = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.trace_flags          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.use_chap_auth        = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_clear         = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_clear_size    = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] QuobyteHD.volumes_dir          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: INFO cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a ...
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 -c /etc/quobyte/client-cinder.cfg {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl      = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_notifications.driver = [] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_notifications.retry = -1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] oslo_messaging_notifications.transport_url = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] key_manager.fixed_key          = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.barbican_api_version  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.barbican_endpoint     = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.barbican_endpoint_type = public {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.barbican_region_name  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.cafile                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.certfile              = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.collect_timing        = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.insecure              = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.keyfile               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.number_of_retries     = 60 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.retry_delay           = 1 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.send_service_user_token = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.split_loggers         = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.timeout               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.tls_ciphers           = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.tls_min_version       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.verify_ssl            = True {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican.verify_ssl_path       = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.auth_section = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.auth_type = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.cafile   = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.certfile = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.collect_timing = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.insecure = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.keyfile  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.split_loggers = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.timeout  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.tls_ciphers = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] barbican_service_user.tls_min_version = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.approle_role_id          = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.approle_secret_id        = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.auth_method              = approle {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.auth_path                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.kv_mountpoint            = secret {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.kv_path                  = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.kv_version               = 2 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.namespace                = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.root_token_id            = **** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.ssl_ca_crt_file          = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.timeout                  = 60.0 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.token_file               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.token_role               = None {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.use_ssl                  = False {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:08:55 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] ******************************************************************************** {{(pid=85620) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:08:55 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 -c /etc/quobyte/client-cinder.cfg
Sep 23 00:08:55 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:55 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.454s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:55 devstack cinder-volume[85870]: INFO cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a succeeded
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.472s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:55 devstack sudo[85979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:08:55 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:55 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.263s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:55 devstack cinder-volume[85870]: INFO cinder.volume.driver [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.volume.driver [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85870) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_db.sqlalchemy.engines [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85870) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG dbcounter [-] [85870] Writer thread running {{(pid=85870) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.db.api [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Building query based on filter {{(pid=85870) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.image.image_utils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85870) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:08:55 devstack cinder-volume[85870]: INFO cinder.keymgr.migration [None req-72023551-e661-4ea3-8eee-dd1c68aa6d19 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:08:55 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:55 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:08:55 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:56 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.266s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG cinder.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Notifying Schedulers of capabilities ... {{(pid=85870) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:08:56 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Driver initialization completed successfully.
Sep 23 00:08:56 devstack cinder-volume[85870]: INFO cinder.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Initiating service 3 cleanup
Sep 23 00:08:56 devstack cinder-volume[85870]: INFO cinder.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Service 3 cleanup completed.
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG cinder.service [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Creating RPC server for service cinder-volume {{(pid=85870) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG cinder.service [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85870) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:08:56 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:08:56 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:08:56 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:08:56 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Sep 23 00:08:56 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.335s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:08:56 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-96501c89-6a9c-4b8a-bfc2-4ba591cc0c6c None None] Driver post RPC initialization completed successfully.
Sep 23 00:09:01 devstack cinder-volume[85620]: INFO oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Caught SIGTERM, stopping children
Sep 23 00:09:01 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Acquiring lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:09:01 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Acquired lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:09:01 devstack cinder-volume[85620]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Releasing lock "singleton_lock" {{(pid=85620) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:09:01 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Stop services. {{(pid=85620) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 23 00:09:01 devstack cinder-volume[85620]: DEBUG oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Killing children. {{(pid=85620) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 23 00:09:01 devstack cinder-volume[85620]: INFO oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Waiting on 1 children to exit
Sep 23 00:09:04 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Acquiring lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:09:04 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Acquired lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:09:04 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Releasing lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:09:04 devstack cinder-volume[85870]: WARNING amqp [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:09:04 devstack cinder-volume[85870]: WARNING amqp [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 00:09:04 devstack cinder-volume[85620]: INFO oslo_service.backend._eventlet.service [None req-21ed3a53-7d47-43bb-b65b-5087aa038daf None None] Child 85870 exited with status 0
Sep 23 00:09:05 devstack cinder-volume[86325]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 23 00:09:05 devstack cinder-volume[86325]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:09:05 devstack cinder-volume[86325]: we strongly recommend against using it for new projects.
Sep 23 00:09:05 devstack cinder-volume[86325]: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:09:05 devstack cinder-volume[86325]: framework.  For more detail see
Sep 23 00:09:05 devstack cinder-volume[86325]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:09:05 devstack cinder-volume[86325]:   import eventlet  # noqa
Sep 23 00:09:08 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 23 00:09:08 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 23 00:09:08 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 23 00:09:09 devstack cinder-volume[86325]: INFO dbcounter [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Registered counter for database cinder
Sep 23 00:09:09 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writer thread running {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:09:10 devstack cinder-volume[86325]: INFO cinder.rpc [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 00:09:10 devstack cinder-volume[86325]: INFO cinder.rpc [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:09:10 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Determined volume DB was empty at startup.
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG cinder.volume.manager [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86325) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 23 00:09:10 devstack cinder-volume[86325]: WARNING stevedore.named [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 00:09:10 devstack cinder-volume[86325]: WARNING castellan.key_manager [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:09:10 devstack cinder-volume[86325]: WARNING cinder.keymgr.conf_key_mgr [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 00:09:10 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:09:10 devstack cinder-volume[86325]: INFO oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Starting 1 workers
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Started child 86631 {{(pid=86325) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Full set of CONF: {{(pid=86325) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] ******************************************************************************** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] Configuration options gathered from: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 23 00:09:10 devstack cinder-volume[86631]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] ================================================================================ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] allow_availability_zone_fallback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] allow_compression_on_image_upload = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] allowed_direct_url_schemes     = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] api_rate_limit                 = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] auth_strategy                  = keystone {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_availability_zone      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_host                   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_name                   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_stats_polling_interval = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backup_api_class               = cinder.backup.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backup_name_template           = backup-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backup_use_same_host           = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backup_use_temp_snapshot       = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] chap_password                  = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] chap_username                  =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_internal_tenant_project_id = e9b60effce104786b9893ebae16a0216 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_internal_tenant_user_id = f8e4721e67b742018053952b65b613ee {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cluster                        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] compression_format             = gzip {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] config_dir                     = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] config_source                  = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] control_exchange               = openstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] debug                          = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] default_availability_zone      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] default_group_type             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] default_volume_type            = QuobyteHD {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] deployment_max_gigabytes       = -1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] disk_geometry                  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_client_cert             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_client_cert_key         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_data_namespace          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_ssl_cert_path           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_ssl_cert_verify         = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] driver_use_ssl                 = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] enable_new_services            = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] enable_unsupported_driver      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] enforce_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] filter_function                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_api_insecure            = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_api_servers             = ['http://192.168.122.80/image'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_api_ssl_compression     = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_ca_certificates_file    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_certfile                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_keyfile                 = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_num_retries             = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance_request_timeout         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] goodness_function              = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] graceful_shutdown_timeout      = 5 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] group_api_class                = cinder.group.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] host                           = devstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_compress_on_upload       = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_conversion_address_space_limit = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_conversion_cpu_limit     = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_conversion_disable       = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_introspection_address_space_limit = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_introspection_cpu_limit  = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_upload_use_cinder_backend = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_upload_use_internal_tenant = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_volume_cache_enabled     = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_volume_cache_max_count   = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] image_volume_cache_max_size_gb = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] init_host_max_objects_retrieval = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iscsi_target_flags             =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iscsi_write_cache              = on {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iser_helper                    = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iser_ip_address                = 192.168.122.80 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iser_port                      = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_color                      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_config_append              = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_dir                        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_file                       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_options                    = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_rotate_interval            = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_rotate_interval_type       = days {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] log_rotation_type              = none {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86631) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] max_age                        = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] max_logfile_count              = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] max_logfile_size_mb            = 200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] max_over_subscription_ratio    = 20.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] message_reap_interval          = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] message_ttl                    = 2592000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] migration_create_volume_timeout_secs = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] monkey_patch                   = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] monkey_patch_modules           = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] my_ip                          = 192.168.122.80 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] no_snapshot_gb_quota           = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] num_iser_scan_tries            = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] num_shell_tries                = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] num_volume_device_scan_tries   = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] nvmeof_conn_info_version       = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] nvmet_ns_id                    = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] nvmet_port_id                  = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_max_limit                = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_ext_list          = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_listen_port       = 8776 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_use_ssl           = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] osapi_volume_workers           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] per_volume_size_limit          = -1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] periodic_fuzzy_delay           = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] periodic_interval              = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] public_endpoint                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] publish_errors                 = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_backup_gigabytes         = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_backups                  = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_gigabytes                = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_groups                   = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_snapshots                = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] quota_volumes                  = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] rate_limit_burst               = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] rate_limit_except_level        = CRITICAL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] rate_limit_interval            = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] reinit_driver_count            = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] replication_device             = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] report_discard_supported       = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] report_interval                = 120 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] reservation_clean_interval     = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] reservation_expire             = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] reserved_image_namespaces      = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] reserved_percentage            = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] rpc_response_timeout           = 120 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] run_external_periodic_tasks    = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] scst_target_driver             = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] scst_target_iqn_name           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_down_time              = 720 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] shell_completion               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] snapshot_name_template         = snapshot-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] split_loggers                  = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] state_path                     = /opt/stack/data/cinder {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] storage_availability_zone      = nova {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] storage_protocol               = iSCSI {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] syslog_log_facility            = LOG_USER {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_helper                  = lioadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_ip_address              = 192.168.122.80 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_port                    = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_protocol                = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] target_secondary_ip_addresses  = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] trace_flags                    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] transport_url                  = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] until_refresh                  = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_chap_auth                  = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_default_quota_class        = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_journal                    = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_json                       = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_multipath_for_image_xfer   = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_stderr                     = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] use_syslog                     = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] verify_glance_signatures       = enabled {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_api_class               = cinder.volume.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_backend_name            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_clear                   = zero {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_clear_ionice            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_clear_size              = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_copy_bps_limit          = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_dd_blocksize            = 1M {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_name_template           = volume-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_service_inithost_offload = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volume_usage_audit_period      = month {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] zoning_mode                    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_concurrency.disable_process_locking = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.auth_type   = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.auth_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.cache       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.certfile    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.include_service_catalog = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.insecure    = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.interface   = public {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.keyfile     = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcache_username = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.region_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.service_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.backend                  = dogpile.cache.null {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.backend_argument         = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.backend_expiration_time  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.config_prefix            = cache.oslo {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.debug_cache_backend      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.enable_retry_client      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.enable_socket_keepalive  = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.enabled                  = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.expiration_time          = 600 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.hashclient_retry_attempts = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_dead_retry      = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_sasl_enabled    = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.password                 = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.proxies                  = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.redis_db                 = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.redis_server             = localhost:6379 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.retry_attempts           = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.retry_delay              = 0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.socket_keepalive_count   = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.socket_keepalive_idle    = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.socket_keepalive_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.socket_timeout           = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.tls_allowed_ciphers      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.tls_cafile               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.tls_certfile             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.tls_enabled              = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.tls_keyfile              = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cache.username                 = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86631) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 23 00:09:10 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] coordination.backend_url       = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.asyncio_connection    = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.asyncio_slave_connection = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.backend               = sqlalchemy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.connection            = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Running cmd (subprocess): mount.quobyte {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.connection_debug      = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.connection_parameters =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.connection_recycle_time = 3600 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.connection_trace      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.db_inc_retry_interval = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.db_max_retries        = 20 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.db_max_retry_interval = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.db_retry_interval     = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.max_overflow          = 50 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.max_pool_size         = 5 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.max_retries           = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.mysql_wsrep_sync_wait = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.pool_timeout          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.retry_interval        = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.slave_connection      = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.sqlite_synchronous    = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.synchronous_reader    = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] database.use_db_reconnect      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_tracing.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.connection_string     = messaging:// {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.enabled               = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.es_doc_type           = notification {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.es_scroll_size        = 10000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.es_scroll_time        = 2m {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.filter_error_trace    = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.hmac_keys             = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.sentinel_service_name = mymaster {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.socket_timeout        = 0.1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.trace_requests        = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler.trace_sqlalchemy      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler_jaeger.process_tags   = {} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler_jaeger.service_name_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] profiler_otlp.service_name_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.enforce_new_defaults = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.policy_default_rule = default {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.group          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.helper_command = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] privsep_osbrick.user           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.group         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.helper_command = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] cinder_sys_admin.user          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.auth_section      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.auth_type         = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.cafile            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.certfile          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.collect_timing    = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.insecure          = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.keyfile           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.send_service_user_token = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.split_loggers     = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.timeout           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.tls_ciphers       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] service_user.tls_min_version   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.auth_section            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.auth_type               = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.certfile                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.collect_timing          = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.insecure                = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.keyfile                 = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.region_name             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.split_loggers           = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.timeout                 = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.tls_ciphers             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] glance.tls_min_version         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.backend_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.chap_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.chap_username =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.disk_geometry = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_client_cert = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_client_cert_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_data_namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.driver_use_ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.extra_capabilities = {} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.filter_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.goodness_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iscsi_target_flags =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iscsi_write_cache = on {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iser_port     = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_host      =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_login     = admin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_mount_options = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_password  = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_private_key =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_share_path =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.num_shell_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.quobyte_volume_url = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.replication_device = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.report_discard_supported = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.reserved_percentage = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_helper = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_port   = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_protocol = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.trace_flags   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.unique_fqdn_network = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.use_chap_auth = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_backend_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_clear  = zero {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_clear_ionice = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_clear_size = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_reports.file_event_handler = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_reports.log_dir           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.backend_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.backend_host         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.chap_password        = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.chap_username        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.disk_geometry        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_client_cert   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_data_namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.extra_capabilities   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.filter_function      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.goodness_function    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iser_helper          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iser_ip_address      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iser_port            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_host             = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_login            = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_mount_options    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_password         = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_private_key      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_share_path       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.num_shell_tries      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.replication_device   = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.report_discard_supported = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.reserved_percentage  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.scst_target_driver   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.storage_protocol     = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_helper        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_ip_address    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_port          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_prefix        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_protocol      = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.trace_flags          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.use_chap_auth        = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_clear         = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_clear_size    = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] QuobyteHD.volumes_dir          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_notifications.driver = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_notifications.retry = -1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] key_manager.fixed_key          = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.barbican_api_version  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.barbican_endpoint     = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.barbican_endpoint_type = public {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.barbican_region_name  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.cafile                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.certfile              = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.collect_timing        = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.insecure              = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.keyfile               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.number_of_retries     = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.retry_delay           = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.send_service_user_token = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.split_loggers         = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.timeout               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.tls_ciphers           = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.tls_min_version       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.verify_ssl            = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican.verify_ssl_path       = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.auth_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.cafile   = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.collect_timing = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.keyfile  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.timeout  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.tls_ciphers = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] barbican_service_user.tls_min_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.approle_role_id          = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.approle_secret_id        = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.auth_method              = approle {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.auth_path                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.kv_mountpoint            = secret {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.kv_path                  = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.kv_version               = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.namespace                = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.root_token_id            = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.ssl_ca_crt_file          = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.timeout                  = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.token_file               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.token_role               = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.use_ssl                  = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 23 00:09:10 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-46f81030-a938-4bf4-9adf-09152d9c2b9a None None] ******************************************************************************** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 23 00:09:11 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.297s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.volume.driver [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.volume.driver [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86631) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_db.sqlalchemy.engines [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writer thread running {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.db.api [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Building query based on filter {{(pid=86631) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86631) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.keymgr.migration [None req-aa3f6ebe-bfbd-43d8-970d-199f36ad4b53 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 00:09:11 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:09:11 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:11 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.242s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Driver initialization completed successfully.
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Initiating service 3 cleanup
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Service 3 cleanup completed.
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.service [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Creating RPC server for service cinder-volume {{(pid=86631) start /opt/stack/cinder/cinder/service.py:231}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.service [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86631) start /opt/stack/cinder/cinder/service.py:237}}
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:09:11 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:09:11 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:09:11 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Sep 23 00:09:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.253s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:09:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-27cf05b2-1928-4a64-a07e-d8a98c21d62c None None] Driver post RPC initialization completed successfully.
Sep 23 00:09:20 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:09:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=3 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:09:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:09:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:09:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 6 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:09:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:10:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:10:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Flow 'volume_create_manager' (ff3759a5-e943-4925-99fa-c12405ed46f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa27cc8d-5545-4351-8200-42f2d08ce38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa27cc8d-5545-4351-8200-42f2d08ce38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-827477539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958cb28f-7f06-4d49-a6db-8b74c6aa8f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc313475d9d4968b6345cdb235601a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:10Z,use_quota=True,user_id='0ca1382a7659424da1bedfcb76d755a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292f928a-fac4-4d68-b7a0-bdf87516886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292f928a-fac4-4d68-b7a0-bdf87516886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf237c15-6c96-4dfe-83c2-bbbddfdbda18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf237c15-6c96-4dfe-83c2-bbbddfdbda18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958cb28f-7f06-4d49-a6db-8b74c6aa8f9c', 'volume_name': 'volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1de69c-d7ca-4e50-8d7c-a5d9f035aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1de69c-d7ca-4e50-8d7c-a5d9f035aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aea370-234e-48ed-b845-99c72e8868d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Volume 958cb28f-7f06-4d49-a6db-8b74c6aa8f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c', 'volume_size': 1}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-827477539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958cb28f-7f06-4d49-a6db-8b74c6aa8f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc313475d9d4968b6345cdb235601a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:10Z,use_quota=True,user_id='0ca1382a7659424da1bedfcb76d755a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Creating volume 958cb28f-7f06-4d49-a6db-8b74c6aa8f9c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:10:10 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:10 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c 1073741824
Sep 23 00:10:10 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:10 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c 1073741824" returned: 0 in 0.734s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:10 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c
Sep 23 00:10:10 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:11 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" returned: 0 in 0.419s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aea370-234e-48ed-b845-99c72e8868d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2f5962-c9da-4c68-bc73-b6badf17b5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Volume volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c (958cb28f-7f06-4d49-a6db-8b74c6aa8f9c): created successfully
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2f5962-c9da-4c68-bc73-b6badf17b5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Flow 'volume_create_manager' (ff3759a5-e943-4925-99fa-c12405ed46f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-10ac61cc-dec9-4407-8da5-aba78d155f23 tempest-TaggedAttachmentsTest-79649070 None] Created volume successfully.
Sep 23 00:10:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:10:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Flow 'volume_create_manager' (589e7d06-486c-415a-b749-ae8023a133a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b8b32c-3e86-4fb5-95c6-1c7b20ac2af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b8b32c-3e86-4fb5-95c6-1c7b20ac2af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1132238034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afdfd3d-7240-48ea-a908-5460e0a30860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986efb35f9b84dca9ed0904dd76eac8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:39Z,use_quota=True,user_id='621c8c23527446e2bfb944544a59b24c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb06aa4b-d389-4136-b6aa-7e3a522c16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb06aa4b-d389-4136-b6aa-7e3a522c16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f599f4-d273-48da-b552-d9ba9da35df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f599f4-d273-48da-b552-d9ba9da35df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afdfd3d-7240-48ea-a908-5460e0a30860', 'volume_name': 'volume-7afdfd3d-7240-48ea-a908-5460e0a30860', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd6eeaa-3cf3-428d-b35c-18dfc0b242a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd6eeaa-3cf3-428d-b35c-18dfc0b242a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c5bbd8-1265-443b-9764-c557573016ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:39 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Volume 7afdfd3d-7240-48ea-a908-5460e0a30860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afdfd3d-7240-48ea-a908-5460e0a30860', 'volume_size': 1}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1132238034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afdfd3d-7240-48ea-a908-5460e0a30860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986efb35f9b84dca9ed0904dd76eac8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:39Z,use_quota=True,user_id='621c8c23527446e2bfb944544a59b24c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Creating volume 7afdfd3d-7240-48ea-a908-5460e0a30860 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:10:39 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:10:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:39 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 1073741824
Sep 23 00:10:39 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:40 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 1073741824" returned: 0 in 1.110s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:40 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860
Sep 23 00:10:40 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:41 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860" returned: 0 in 0.726s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c5bbd8-1265-443b-9764-c557573016ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afdfd3d-7240-48ea-a908-5460e0a30860', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c33451a-51ce-40b9-b368-d7d29ec4e822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Volume volume-7afdfd3d-7240-48ea-a908-5460e0a30860 (7afdfd3d-7240-48ea-a908-5460e0a30860): created successfully
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c33451a-51ce-40b9-b368-d7d29ec4e822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Flow 'volume_create_manager' (589e7d06-486c-415a-b749-ae8023a133a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f59c3db0-b8cb-4dfb-a4e0-8f51db0b495f tempest-DeleteServersTestJSON-482694245 None] Created volume successfully.
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Flow 'volume_create_manager' (c63211a9-f4f8-4938-8906-e69e155ae7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75146b4e-3e8e-4344-b5d3-e84898b49c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75146b4e-3e8e-4344-b5d3-e84898b49c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-546743872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9119f25f888d473193563eb7db3e5398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:45Z,use_quota=True,user_id='4c503ae6e2264ea59447839356dad935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca726e-eab8-4199-b8c7-40d977e6793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca726e-eab8-4199-b8c7-40d977e6793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45502c70-cc06-4844-be5e-ae054ae30ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45502c70-cc06-4844-be5e-ae054ae30ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f', 'volume_name': 'volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd06309-8ac3-49f3-9921-9f44c5d7b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd06309-8ac3-49f3-9921-9f44c5d7b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97f3349-13d0-42ea-b948-3b71ed09c407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Volume c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f', 'volume_size': 1}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-546743872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9119f25f888d473193563eb7db3e5398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:45Z,use_quota=True,user_id='4c503ae6e2264ea59447839356dad935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Creating volume c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:10:45 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:10:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:45 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f 1073741824
Sep 23 00:10:45 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:46 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f 1073741824" returned: 0 in 1.258s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:46 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f
Sep 23 00:10:46 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:47 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" returned: 0 in 0.590s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97f3349-13d0-42ea-b948-3b71ed09c407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c70140-0106-4c12-88f5-9dbd70efd5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:10:47 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Volume volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f (c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f): created successfully
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c70140-0106-4c12-88f5-9dbd70efd5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:10:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Flow 'volume_create_manager' (c63211a9-f4f8-4938-8906-e69e155ae7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:10:47 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d48e7087-f953-42a4-bed4-20019b681826 tempest-VolumesAdminNegativeTest-1091897476 None] Created volume successfully.
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Acquiring lock "cinder-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "cinder-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Acquiring lock "cinder-quobyte-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "cinder-quobyte-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:10:49 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsriowaql/privsep.sock']
Sep 23 00:10:49 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsriowaql/privsep.sock
Sep 23 00:10:49 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:49 devstack cinder-volume[86631]: WARNING py.warnings [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 23 00:10:49 devstack cinder-volume[86631]:   .first()
Sep 23 00:10:49 devstack cinder-volume[86631]: 
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-7afdfd3d-7240-48ea-a908-5460e0a30860', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9da4831-a064-4bf8-bc9d-d541bed7a108', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:10:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-5ad5f699-f1fa-4962-b3a2-ec2731327e7a req-b9d06e41-b716-455d-b63c-ce9de32b43b9 tempest-DeleteServersTestJSON-482694245 None] attachment_update completed successfully.
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 23 00:10:52 devstack cinder-volume[86631]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 23 00:10:53 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:53 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Spawned new privsep daemon via rootwrap
Sep 23 00:10:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Accepted privsep connection to /tmp/tmpsriowaql/privsep.sock {{(pid=86631) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 23 00:10:53 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 23 00:10:53 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 23 00:10:53 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 23 00:10:53 devstack cinder-volume[86631]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88658
Sep 23 00:10:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a027f8-2951-4aaa-aae8-8dc24aa0de08]: (2,) {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:10:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b9fecc-9eda-4824-8a38-2466c795ec01]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:10:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:53 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f
Sep 23 00:10:53 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:54 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" returned: 0 in 0.855s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:54 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f
Sep 23 00:10:54 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:54 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" returned: 0 in 0.836s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "cinder-quobyte-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f" released by "delete_volume" :: held 5.461s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:10:55 devstack cinder-volume[86631]: WARNING cinder.quota [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:10:55 devstack cinder-volume[86631]: WARNING cinder.quota [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Created reservations ['8b1e1ed7-edea-4a89-9619-7b40f347f1fe', '167a3677-4fcc-4df2-bca1-ef9ca1466a21', 'c0121716-cfc0-4c6c-aa8a-9f4b8adfaac7', 'd280d88e-eacb-4fff-ae60-aa8d4f80e60f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:55 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:10:55 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:56 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.613s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:10:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Deleted volume successfully.
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-41207360-a1fb-4545-954f-fddf6f66e068 tempest-VolumesAdminNegativeTest-1091897476 None] Lock "cinder-c61d0ffe-4a3c-4e57-b140-57ac0e12ca0f-delete_volume" released by "delete_volume" :: held 7.029s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:10:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:56 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:10:56 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:10:57 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.608s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 8 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:10:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-9f6ba6c4-b8bd-4acd-b6f5-818700e13e50 req-9d63ad83-e17b-4dc4-ac5c-b4c44b39681f tempest-DeleteServersTestJSON-482694245 None] Terminate volume connection completed successfully.
Sep 23 00:10:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-9f6ba6c4-b8bd-4acd-b6f5-818700e13e50 req-9d63ad83-e17b-4dc4-ac5c-b4c44b39681f tempest-DeleteServersTestJSON-482694245 None] Deleting attachment e9da4831-a064-4bf8-bc9d-d541bed7a108. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "cinder-7afdfd3d-7240-48ea-a908-5460e0a30860-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "cinder-7afdfd3d-7240-48ea-a908-5460e0a30860-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "cinder-quobyte-7afdfd3d-7240-48ea-a908-5460e0a30860" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "cinder-quobyte-7afdfd3d-7240-48ea-a908-5460e0a30860" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c0bd5-0581-42a6-87b1-0558b88794ed]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:10:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:10:59 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860
Sep 23 00:10:59 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:00 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:00 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860
Sep 23 00:11:00 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:00 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7afdfd3d-7240-48ea-a908-5460e0a30860" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "cinder-quobyte-7afdfd3d-7240-48ea-a908-5460e0a30860" released by "delete_volume" :: held 0.818s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Created reservations ['832dfff5-9733-46ff-a5fb-aa91e4490468', 'bb168dff-b476-420b-b5a6-e684df92835a', '361a1887-b870-4621-9b7b-ade819d1c26a', '15b5a8e3-f8ea-4ce8-8ed7-8c4f1062b20a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:00 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:11:00 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:01 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:01 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Deleted volume successfully.
Sep 23 00:11:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3af53b8-a242-42a5-a849-8cbc76deb475 tempest-DeleteServersTestJSON-482694245 None] Lock "cinder-7afdfd3d-7240-48ea-a908-5460e0a30860-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:10 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=24,cinder:SELECT=23,cinder:INSERT=6 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:11:11 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:11:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-18c29fc9-fe67-4d79-9969-590ad9a0bca9 tempest-BackendsCapabilitiesAdminTestsJSON-460838739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86631) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:11:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5bee16d-0ce8-4cfa-b03b-ef6c59a5ed62 tempest-BackendsCapabilitiesAdminTestsJSON-460838739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86631) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:11:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:11:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-05a4d7be-30b8-467d-9960-2855ae69bea4 req-9389a9a3-2c78-4991-a22f-bec380ff4e92 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-05a4d7be-30b8-467d-9960-2855ae69bea4 req-9389a9a3-2c78-4991-a22f-bec380ff4e92 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-05a4d7be-30b8-467d-9960-2855ae69bea4 req-9389a9a3-2c78-4991-a22f-bec380ff4e92 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-05a4d7be-30b8-467d-9960-2855ae69bea4 req-9389a9a3-2c78-4991-a22f-bec380ff4e92 tempest-TaggedAttachmentsTest-79649070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b120f50-ece5-4b70-ae91-efcef480083d', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:11:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-05a4d7be-30b8-467d-9960-2855ae69bea4 req-9389a9a3-2c78-4991-a22f-bec380ff4e92 tempest-TaggedAttachmentsTest-79649070 None] attachment_update completed successfully.
Sep 23 00:11:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c08ed229-2d97-4aaf-abd2-7cd3caa7da88 tempest-GroupsTest-520698592 None] Group tempest-Group1-1784894649: creating
Sep 23 00:11:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c08ed229-2d97-4aaf-abd2-7cd3caa7da88 tempest-GroupsTest-520698592 None] Group tempest-Group1-1784894649: created successfully
Sep 23 00:11:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c08ed229-2d97-4aaf-abd2-7cd3caa7da88 tempest-GroupsTest-520698592 None] Create group completed successfully.
Sep 23 00:11:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bc224cab-ddff-4880-9693-1fe26c428fec tempest-GroupsTest-520698592 None] Group tempest-Group2-2009143372: creating
Sep 23 00:11:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bc224cab-ddff-4880-9693-1fe26c428fec tempest-GroupsTest-520698592 None] Group tempest-Group2-2009143372: created successfully
Sep 23 00:11:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bc224cab-ddff-4880-9693-1fe26c428fec tempest-GroupsTest-520698592 None] Create group completed successfully.
Sep 23 00:11:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7a438c9e-f972-47f8-85db-0a4d9f6ce20a req-e6cd7a60-4576-4b82-b818-393d894bfb43 tempest-TaggedAttachmentsTest-79649070 None] Terminate volume connection completed successfully.
Sep 23 00:11:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7a438c9e-f972-47f8-85db-0a4d9f6ce20a req-e6cd7a60-4576-4b82-b818-393d894bfb43 tempest-TaggedAttachmentsTest-79649070 None] Deleting attachment 0b120f50-ece5-4b70-ae91-efcef480083d. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (3dae89f2-4b7c-4d5a-8878-639af11d8b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfcd472-369c-4327-bfc7-2eadd4a57618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfcd472-369c-4327-bfc7-2eadd4a57618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-617744583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8f2a785-84e2-45a6-8ad1-47ff7094461d,host='devstack@QuobyteHD#QuobyteHD',id=e2981762-396f-4604-92a0-7c966a7aa667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:36Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe609ac7-eb94-4b66-b148-bcf5682e45d6),volume_type_id=fe609ac7-eb94-4b66-b148-bcf5682e45d6)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff96ef-90f2-48ee-a122-3baf68f4c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff96ef-90f2-48ee-a122-3baf68f4c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a0d6d0-75da-4999-a538-889f09ee28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a0d6d0-75da-4999-a538-889f09ee28fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2981762-396f-4604-92a0-7c966a7aa667', 'volume_name': 'volume-e2981762-396f-4604-92a0-7c966a7aa667', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d1478f-3962-4c95-b8fa-6a5b4598178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d1478f-3962-4c95-b8fa-6a5b4598178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb325f40-47ed-4a3b-bde9-c3d7118ad32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Volume e2981762-396f-4604-92a0-7c966a7aa667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2981762-396f-4604-92a0-7c966a7aa667', 'volume_size': 1}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c8f2a785-84e2-45a6-8ad1-47ff7094461d,created_at=2026-09-22T22:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-617744583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8f2a785-84e2-45a6-8ad1-47ff7094461d,host='devstack@QuobyteHD#QuobyteHD',id=e2981762-396f-4604-92a0-7c966a7aa667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:36Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe609ac7-eb94-4b66-b148-bcf5682e45d6),volume_type_id=fe609ac7-eb94-4b66-b148-bcf5682e45d6)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Creating volume e2981762-396f-4604-92a0-7c966a7aa667 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:11:35 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:11:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:36 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 1073741824
Sep 23 00:11:36 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:36 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 1073741824" returned: 0 in 0.748s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:36 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667
Sep 23 00:11:36 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:37 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb325f40-47ed-4a3b-bde9-c3d7118ad32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2981762-396f-4604-92a0-7c966a7aa667', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99bb8b6-4e7c-4acb-be2e-54433f1d17a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Volume volume-e2981762-396f-4604-92a0-7c966a7aa667 (e2981762-396f-4604-92a0-7c966a7aa667): created successfully
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99bb8b6-4e7c-4acb-be2e-54433f1d17a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (3dae89f2-4b7c-4d5a-8878-639af11d8b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e3d9df3d-11c4-4a18-8305-d043b2b5fbb8 tempest-GroupsTest-520698592 None] Created volume successfully.
Sep 23 00:11:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Acquiring lock "cinder-quobyte-e2981762-396f-4604-92a0-7c966a7aa667" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:11:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-e2981762-396f-4604-92a0-7c966a7aa667" acquired by "delete_volume" :: waited 0.044s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:11:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89263e-3576-4847-874b-66eefba488f3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:11:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:41 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667
Sep 23 00:11:41 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:42 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667" returned: 0 in 1.092s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:42 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667
Sep 23 00:11:42 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:42 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e2981762-396f-4604-92a0-7c966a7aa667" returned: 0 in 0.482s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-e2981762-396f-4604-92a0-7c966a7aa667" released by "delete_volume" :: held 1.697s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Created reservations ['f98fba32-3335-4d48-82d3-ffb7070b0a89'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:11:42 devstack cinder-volume[86631]: WARNING cinder.quota [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1497271437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1497271437, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:11:42 devstack cinder-volume[86631]: WARNING cinder.quota [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1497271437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1497271437, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:11:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Created reservations ['73a83147-b4ba-4e52-87fe-0030fca5b1e1', '3c4e19d0-9625-40bf-89df-baecbbc463ea', 'c2a9ad06-80b5-47ff-8088-ccf1acc60904', '134ec55e-66f2-41b5-beca-59065353636a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:43 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:11:43 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:43 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:43 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d8910394-bfc7-4b8a-abf7-65cfe3a88289 tempest-GroupsTest-520698592 None] Delete group completed successfully.
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Created reservations ['81afcab4-f8e2-46bf-94e1-1666128e0398'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:44 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:11:44 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:44 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.482s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:44 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1ccf659e-7967-4168-b8da-17739c055d33 tempest-GroupsTest-520698592 None] Delete group completed successfully.
Sep 23 00:11:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-18498a15-50b4-4971-a812-9db015f0fb75 tempest-GroupsTest-520698592 None] Group tempest-GroupsTest-Group-1935484057: creating
Sep 23 00:11:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-18498a15-50b4-4971-a812-9db015f0fb75 tempest-GroupsTest-520698592 None] Group tempest-GroupsTest-Group-1935484057: created successfully
Sep 23 00:11:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-18498a15-50b4-4971-a812-9db015f0fb75 tempest-GroupsTest-520698592 None] Create group completed successfully.
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (11d366bb-a670-4883-9de6-3427a8d2e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d024b83-011f-4fcc-bd7b-cf88157f2d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d024b83-011f-4fcc-bd7b-cf88157f2d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1431099987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e76b16e1-d6f3-403f-93c6-39324e982413,host='devstack@QuobyteHD#QuobyteHD',id=a8086806-59f4-4b2b-b264-fc9c01b92cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:48Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6fb52c-013c-459b-adf0-3becd1161bee),volume_type_id=0e6fb52c-013c-459b-adf0-3becd1161bee)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d20e64f-7565-47a8-b2cd-980e3c459c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d20e64f-7565-47a8-b2cd-980e3c459c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2cf99c-4611-4ed1-9dc8-fefdb221e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2cf99c-4611-4ed1-9dc8-fefdb221e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8086806-59f4-4b2b-b264-fc9c01b92cd4', 'volume_name': 'volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f132b0-61ae-4ac6-86aa-830c003b8238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f132b0-61ae-4ac6-86aa-830c003b8238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4fd1ca-631e-4e1b-a8ab-6046915c2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:48 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Volume a8086806-59f4-4b2b-b264-fc9c01b92cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4', 'volume_size': 1}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e76b16e1-d6f3-403f-93c6-39324e982413,created_at=2026-09-22T22:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1431099987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e76b16e1-d6f3-403f-93c6-39324e982413,host='devstack@QuobyteHD#QuobyteHD',id=a8086806-59f4-4b2b-b264-fc9c01b92cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:48Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6fb52c-013c-459b-adf0-3becd1161bee),volume_type_id=0e6fb52c-013c-459b-adf0-3becd1161bee)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Creating volume a8086806-59f4-4b2b-b264-fc9c01b92cd4 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:11:48 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:11:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:48 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 1073741824
Sep 23 00:11:48 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:49 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 1073741824" returned: 0 in 0.756s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:49 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4
Sep 23 00:11:49 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:49 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:11:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4fd1ca-631e-4e1b-a8ab-6046915c2685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16de11fb-7098-4d1a-951a-b593f0a922d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Volume volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 (a8086806-59f4-4b2b-b264-fc9c01b92cd4): created successfully
Sep 23 00:11:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16de11fb-7098-4d1a-951a-b593f0a922d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (11d366bb-a670-4883-9de6-3427a8d2e814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f6adef1e-1c13-42d0-974e-d70e68a057de tempest-GroupsTest-520698592 None] Created volume successfully.
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (b73ef577-a6a9-4261-8e5a-9cb7757ddeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7aa49fc-ccaf-41bf-ba69-22c2eed710be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7aa49fc-ccaf-41bf-ba69-22c2eed710be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296769517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e76b16e1-d6f3-403f-93c6-39324e982413,host='devstack@QuobyteHD#QuobyteHD',id=0abe4909-1b2a-4979-9ab5-fed6df317ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:52Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6fb52c-013c-459b-adf0-3becd1161bee),volume_type_id=0e6fb52c-013c-459b-adf0-3becd1161bee)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef728884-6ac5-4947-a17e-a18e42a2bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef728884-6ac5-4947-a17e-a18e42a2bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d6b7f4-24e6-4b2b-8a57-b035f14e013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d6b7f4-24e6-4b2b-8a57-b035f14e013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abe4909-1b2a-4979-9ab5-fed6df317ab0', 'volume_name': 'volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533aba18-1702-421d-8f00-1184db6d51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533aba18-1702-421d-8f00-1184db6d51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ababac9e-c2ab-4fe9-8667-2091e9626321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:52 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Volume 0abe4909-1b2a-4979-9ab5-fed6df317ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0', 'volume_size': 1}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e76b16e1-d6f3-403f-93c6-39324e982413,created_at=2026-09-22T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296769517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e76b16e1-d6f3-403f-93c6-39324e982413,host='devstack@QuobyteHD#QuobyteHD',id=0abe4909-1b2a-4979-9ab5-fed6df317ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e96fe3ebf40c0b8e944965299151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:52Z,use_quota=True,user_id='8d6b7a6951554490bea90dba16aed5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6fb52c-013c-459b-adf0-3becd1161bee),volume_type_id=0e6fb52c-013c-459b-adf0-3becd1161bee)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Creating volume 0abe4909-1b2a-4979-9ab5-fed6df317ab0 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:11:52 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:11:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:52 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 1073741824
Sep 23 00:11:52 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:53 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 1073741824" returned: 0 in 0.797s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:53 devstack sudo[89570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0
Sep 23 00:11:53 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:54 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ababac9e-c2ab-4fe9-8667-2091e9626321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e4eddf-ea93-445f-876d-ad27bc1c41fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:11:54 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Volume volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 (0abe4909-1b2a-4979-9ab5-fed6df317ab0): created successfully
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e4eddf-ea93-445f-876d-ad27bc1c41fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:11:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Flow 'volume_create_manager' (b73ef577-a6a9-4261-8e5a-9cb7757ddeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:11:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-48f8fc53-de3f-4ca5-8a60-65c1bbe68ebe tempest-GroupsTest-520698592 None] Created volume successfully.
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "cinder-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "cinder-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "cinder-quobyte-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "cinder-quobyte-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c2dfe-0554-4971-b147-5110cb44e588]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1ff42607-9efd-4995-b894-43dd22f75658 tempest-GroupsTest-520698592 None] Update group completed successfully.
Sep 23 00:11:55 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c
Sep 23 00:11:55 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:55 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" returned: 0 in 0.451s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:55 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c
Sep 23 00:11:55 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:56 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" returned: 0 in 0.288s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "cinder-quobyte-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c" released by "delete_volume" :: held 0.792s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Created reservations ['15f2498a-0758-4420-8201-cf1156ea6646', 'f77a65d8-b53b-49eb-a580-463ff238555c', '6afce614-d37d-485d-bc96-eaf1c1856601', 'c4a480fa-624d-48d7-8a9e-1bb89500c849'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:56 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:11:56 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:56 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Deleted volume successfully.
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de872e9a-ab51-4220-9bc7-9a0b13e9c042 tempest-TaggedAttachmentsTest-79649070 None] Lock "cinder-958cb28f-7f06-4d49-a6db-8b74c6aa8f9c-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:11:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:56 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:11:56 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-fd0a7551-8695-4390-8e50-5375274abe29 tempest-GroupsTest-520698592 None] Update group completed successfully.
Sep 23 00:11:57 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.379s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:11:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:11:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 8 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:11:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:11:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Acquiring lock "cinder-quobyte-0abe4909-1b2a-4979-9ab5-fed6df317ab0" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:11:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-0abe4909-1b2a-4979-9ab5-fed6df317ab0" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:11:58 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec313b29-2e96-45ac-abd8-f7f523973b96]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:11:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:59 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0
Sep 23 00:11:59 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:59 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0" returned: 0 in 0.592s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:11:59 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0
Sep 23 00:11:59 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:11:59 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0abe4909-1b2a-4979-9ab5-fed6df317ab0" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-0abe4909-1b2a-4979-9ab5-fed6df317ab0" released by "delete_volume" :: held 0.996s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Acquiring lock "cinder-quobyte-a8086806-59f4-4b2b-b264-fc9c01b92cd4" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:11:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-a8086806-59f4-4b2b-b264-fc9c01b92cd4" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea310a2-d864-4cf2-9165-701705e84445]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:00 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4
Sep 23 00:12:00 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:00 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4" returned: 0 in 0.574s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:00 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4
Sep 23 00:12:00 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:00 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a8086806-59f4-4b2b-b264-fc9c01b92cd4" returned: 0 in 0.280s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "cinder-quobyte-a8086806-59f4-4b2b-b264-fc9c01b92cd4" released by "delete_volume" :: held 0.917s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:00 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Created reservations ['50b2ce5d-e3bf-4fb2-812b-f46285d07197'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:01 devstack cinder-volume[86631]: WARNING cinder.quota [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1034778482 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1034778482, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:01 devstack cinder-volume[86631]: WARNING cinder.quota [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1034778482 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1034778482, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Created reservations ['9721a892-b2fd-483e-b0a9-0ee341b90ef7', 'c29258de-df04-4572-8919-f07e4b178a1c', '1114470a-a6ce-4be3-9ca9-b7f60bf288cc', '522da87f-a043-43ec-bcb3-0c1feb8cb1a6'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Created reservations ['8302f31b-35f8-4fe1-92c1-a3b8113f4a68', 'f6daa82c-5626-4fae-b37d-5ed2d41d045a', '48b11e07-f483-45bd-b525-05bc63374ff2', '2a79826a-d44a-4474-b2ef-551978b102dc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:01 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:01 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:01 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.402s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:01 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f76daafa-a33e-48c1-ba83-6e36d55a0131 tempest-GroupsTest-520698592 None] Delete group completed successfully.
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Flow 'volume_create_manager' (b8412bab-1571-47db-8fcb-dc602f31061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ab3dc-2187-48ee-8e01-d6c7e7ba5cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ab3dc-2187-48ee-8e01-d6c7e7ba5cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1653930569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a119537-5b45-4456-8205-ce041a9dbd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819ba45d99564288a3333eecfc5c4951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:10Z,use_quota=True,user_id='167100895c6748768c4f6441aa652bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ea7d6d-939c-4fe1-825c-399793d806fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ea7d6d-939c-4fe1-825c-399793d806fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dc7767-736e-43b7-9120-2f2f42c5e3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dc7767-736e-43b7-9120-2f2f42c5e3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a119537-5b45-4456-8205-ce041a9dbd5b', 'volume_name': 'volume-3a119537-5b45-4456-8205-ce041a9dbd5b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1404936-44f6-4012-b33a-098f48a9d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1404936-44f6-4012-b33a-098f48a9d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea1afc-ffdb-41b3-8553-90d9e3abd69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Volume 3a119537-5b45-4456-8205-ce041a9dbd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a119537-5b45-4456-8205-ce041a9dbd5b', 'volume_size': 1}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1653930569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a119537-5b45-4456-8205-ce041a9dbd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819ba45d99564288a3333eecfc5c4951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:10Z,use_quota=True,user_id='167100895c6748768c4f6441aa652bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Creating volume 3a119537-5b45-4456-8205-ce041a9dbd5b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:10 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:10 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b 1073741824
Sep 23 00:12:10 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:11 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b 1073741824" returned: 0 in 1.141s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:11 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b
Sep 23 00:12:11 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:11 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b" returned: 0 in 0.497s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea1afc-ffdb-41b3-8553-90d9e3abd69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a119537-5b45-4456-8205-ce041a9dbd5b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02843f86-7109-453c-ab00-8f294f285563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Volume volume-3a119537-5b45-4456-8205-ce041a9dbd5b (3a119537-5b45-4456-8205-ce041a9dbd5b): created successfully
Sep 23 00:12:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02843f86-7109-453c-ab00-8f294f285563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Flow 'volume_create_manager' (b8412bab-1571-47db-8fcb-dc602f31061f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1ac65e05-d8de-41d6-b1d0-136cde38a2cf tempest-AttachVolumeShelveTestJSON-1347846063 None] Created volume successfully.
Sep 23 00:12:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4bedc0af-7602-4be9-abfc-e96eb78622fd tempest-GroupsV320Test-1820065222 None] Group tempest-GroupsV320Test-Group-576590627: creating
Sep 23 00:12:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4bedc0af-7602-4be9-abfc-e96eb78622fd tempest-GroupsV320Test-1820065222 None] Group tempest-GroupsV320Test-Group-576590627: created successfully
Sep 23 00:12:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4bedc0af-7602-4be9-abfc-e96eb78622fd tempest-GroupsV320Test-1820065222 None] Create group completed successfully.
Sep 23 00:12:18 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Created reservations ['f714c13f-b718-483f-b436-e0a9d7f3c821'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:18 devstack cinder-volume[86631]: DEBUG oslo_db.api [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction')
Sep 23 00:12:18 devstack cinder-volume[86631]: [SQL: UPDATE reservations SET deleted_at=%(deleted_at)s, deleted=%(deleted)s, updated_at=%(updated_at)s WHERE reservations.id = %(reservations_id)s]
Sep 23 00:12:18 devstack cinder-volume[86631]: [parameters: {'deleted_at': datetime.datetime(2026, 9, 22, 22, 12, 18, 529053), 'deleted': 1, 'updated_at': datetime.datetime(2026, 9, 22, 22, 12, 18, 532313), 'reservations_id': 64}]
Sep 23 00:12:18 devstack cinder-volume[86631]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86631) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}}
Sep 23 00:12:18 devstack cinder-volume[86631]: DEBUG oslo_db.api [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86631) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Flow 'volume_create_manager' (862525f8-6a42-4ec2-89b0-0084d68f6915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6f422-f2f2-40f1-9d3f-173d858b366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f6f422-f2f2-40f1-9d3f-173d858b366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-309353796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84752aa-deca-4061-815a-22175c94719a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb886b2dc65f420e8ba531c94bbc07c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:19Z,use_quota=True,user_id='e99386a06894475b8df773823c99e1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90a656b-820d-46dd-a7ca-e5e0dc80995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90a656b-820d-46dd-a7ca-e5e0dc80995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62215fd1-7fd6-40b5-acaf-d10b0b40f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62215fd1-7fd6-40b5-acaf-d10b0b40f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84752aa-deca-4061-815a-22175c94719a', 'volume_name': 'volume-a84752aa-deca-4061-815a-22175c94719a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3659de3-3639-4691-bfdb-2bf40da16a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3659de3-3639-4691-bfdb-2bf40da16a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23203c5f-e23a-43a8-81d5-36f16b7094c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Volume a84752aa-deca-4061-815a-22175c94719a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84752aa-deca-4061-815a-22175c94719a', 'volume_size': 1}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-309353796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84752aa-deca-4061-815a-22175c94719a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb886b2dc65f420e8ba531c94bbc07c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:19Z,use_quota=True,user_id='e99386a06894475b8df773823c99e1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Creating volume a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:19 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a 1073741824
Sep 23 00:12:19 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:19 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:19 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:19 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a 1073741824" returned: 0 in 0.749s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:20 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a
Sep 23 00:12:20 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:20 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-20f2362b-f9cc-48e5-97e8-ab5e4001901e tempest-GroupsV320Test-1820065222 None] Delete group completed successfully.
Sep 23 00:12:20 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a" returned: 0 in 0.514s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23203c5f-e23a-43a8-81d5-36f16b7094c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84752aa-deca-4061-815a-22175c94719a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a34133-73b3-40ef-a854-1aed2e49ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Volume volume-a84752aa-deca-4061-815a-22175c94719a (a84752aa-deca-4061-815a-22175c94719a): created successfully
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a34133-73b3-40ef-a854-1aed2e49ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Flow 'volume_create_manager' (862525f8-6a42-4ec2-89b0-0084d68f6915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-fceaac34-3370-4650-a0c0-41f2e89e15c2 req-932e1bf2-207e-4cc8-b40e-be337d649b52 tempest-VolumesSnapshotsTestJSON-1035400106 None] Created volume successfully.
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=63,cinder:UPDATE=65,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=69,cinder:UPDATE=67,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Creating offline snapshot 1f2c3295-6e97-444c-845c-c31ce0a08a61 of volume a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a34c6-ccee-4b9c-ac63-0e56ab887f89]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:22 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a
Sep 23 00:12:22 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:22 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a" returned: 0 in 0.525s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:22 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 1G
Sep 23 00:12:22 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:23 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 1G" returned: 0 in 0.618s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84752aa-deca-4061-815a-22175c94719a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:23 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84752aa-deca-4061-815a-22175c94719a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61
Sep 23 00:12:23 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:23 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84752aa-deca-4061-815a-22175c94719a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61" returned: 0 in 0.343s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 is being set with open permissions: ugo+rw
Sep 23 00:12:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:23 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61
Sep 23 00:12:23 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:24 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61" returned: 0 in 0.498s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:24 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info
Sep 23 00:12:24 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:24 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info" returned: 0 in 0.451s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:24 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info is being set with open permissions: ugo+rw
Sep 23 00:12:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:24 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info
Sep 23 00:12:24 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:25 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.info" returned: 0 in 0.454s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-42125e5a-b195-496a-b24e-5814bf18fc9c req-c1f1cbb4-5025-4adc-8a77-b09a2277082a tempest-VolumesSnapshotsTestJSON-1035400106 None] Create snapshot completed successfully
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "cinder-1f2c3295-6e97-444c-845c-c31ce0a08a61-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-1f2c3295-6e97-444c-845c-c31ce0a08a61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "cinder-quobyte-1f2c3295-6e97-444c-845c-c31ce0a08a61" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-1f2c3295-6e97-444c-845c-c31ce0a08a61" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Deleting offline snapshot 1f2c3295-6e97-444c-845c-c31ce0a08a61 of volume a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] snapshot_file for this snap is: volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[358abe35-7a7b-40d7-9b5f-133a921bcef1]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-0bdbc66b-aefa-436a-b313-28c3e440518b req-296bc770-31e8-4189-bf8b-41d5740750d5 tempest-AttachVolumeShelveTestJSON-1347846063 None] No connector for attachment 916937bc-9e9c-4637-9924-40328b853fd0; skipping storage backend terminate_connection call. {{(pid=86631) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 23 00:12:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-0bdbc66b-aefa-436a-b313-28c3e440518b req-296bc770-31e8-4189-bf8b-41d5740750d5 tempest-AttachVolumeShelveTestJSON-1347846063 None] Deleting attachment 916937bc-9e9c-4637-9924-40328b853fd0. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:12:26 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61
Sep 23 00:12:26 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:27 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61" returned: 0 in 0.489s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84752aa-deca-4061-815a-22175c94719a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa87a3e-9551-46e3-841c-9b12fdae92fa]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:27 devstack sudo[89880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a
Sep 23 00:12:27 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:27 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a" returned: 0 in 0.540s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:27 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61
Sep 23 00:12:27 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:28 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61" returned: 0 in 0.388s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:28 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61
Sep 23 00:12:28 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:28 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a.1f2c3295-6e97-444c-845c-c31ce0a08a61" returned: 0 in 0.313s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-1f2c3295-6e97-444c-845c-c31ce0a08a61" released by "_delete_snapshot" :: held 1.916s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" released by "delete_snapshot" :: held 1.963s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:28 devstack cinder-volume[86631]: WARNING cinder.quota [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.quota [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Created reservations ['d85d2d92-6622-4e9f-91b3-2142d18a1ea6', 'd97e1924-92f3-44d1-8a12-955d1994d1d1', 'f74c7b52-eacb-4d1a-8cb7-41a755922715', '64334cdc-aa9a-4994-81d0-12caa67022bf'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Delete snapshot completed successfully.
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-b79301c7-07d3-46ff-9728-6d22f9ce1e1d req-5e35a997-bc1e-4d97-9579-b35ebe3e7a5e tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-1f2c3295-6e97-444c-845c-c31ce0a08a61-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "cinder-a84752aa-deca-4061-815a-22175c94719a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-a84752aa-deca-4061-815a-22175c94719a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e4362-ac52-4f46-abfe-1e3ecc8b201f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:29 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a
Sep 23 00:12:29 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:29 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a" returned: 0 in 0.774s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:29 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a
Sep 23 00:12:29 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:30 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a84752aa-deca-4061-815a-22175c94719a" returned: 0 in 0.393s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-quobyte-a84752aa-deca-4061-815a-22175c94719a" released by "delete_volume" :: held 1.284s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.quota [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Created reservations ['eb1880df-fe13-424b-875c-b0d0a01018c5', '80680891-bcaf-4962-9d81-c659bc5268fc', '6b3e418c-e117-4189-bd67-186d49bf36b3', '6f1004f8-53e4-4c3e-bd31-5b16c7d05570'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:30 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:30 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:30 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.manager [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Deleted volume successfully.
Sep 23 00:12:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c91ac5bb-8796-430e-9239-7e92298749d3 req-5242da67-f25b-4b31-b461-a97859d97485 tempest-VolumesSnapshotsTestJSON-1035400106 None] Lock "cinder-a84752aa-deca-4061-815a-22175c94719a-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Flow 'volume_create_manager' (be5004c2-8c80-4df4-900d-727e45117b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd2037c-8f4c-4020-a4a0-3665de1f898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd2037c-8f4c-4020-a4a0-3665de1f898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-771962510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56adc4a0-d443-4a34-9b4f-31724a05bef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e74b3ffa8e4fefabfcac9f1b4648ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:35Z,use_quota=True,user_id='1695210b0b144cb6b60a5dd4e8dc0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896310f9-e21f-4815-8ad6-86a00fc921eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896310f9-e21f-4815-8ad6-86a00fc921eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005104e9-d6b7-494a-9f2f-c31e7a536eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005104e9-d6b7-494a-9f2f-c31e7a536eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56adc4a0-d443-4a34-9b4f-31724a05bef6', 'volume_name': 'volume-56adc4a0-d443-4a34-9b4f-31724a05bef6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eec6759-5775-4725-b051-bf6b1bdaabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eec6759-5775-4725-b051-bf6b1bdaabe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664c5eec-9691-49a8-b9e7-4d9ab59ae048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Volume 56adc4a0-d443-4a34-9b4f-31724a05bef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56adc4a0-d443-4a34-9b4f-31724a05bef6', 'volume_size': 1}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-771962510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56adc4a0-d443-4a34-9b4f-31724a05bef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e74b3ffa8e4fefabfcac9f1b4648ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:35Z,use_quota=True,user_id='1695210b0b144cb6b60a5dd4e8dc0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Creating volume 56adc4a0-d443-4a34-9b4f-31724a05bef6 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:35 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:35 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 1073741824
Sep 23 00:12:35 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:36 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 1073741824" returned: 0 in 0.805s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:36 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6
Sep 23 00:12:36 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:36 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664c5eec-9691-49a8-b9e7-4d9ab59ae048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56adc4a0-d443-4a34-9b4f-31724a05bef6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09783934-c4d8-41db-8248-54c1c7f4f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Volume volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 (56adc4a0-d443-4a34-9b4f-31724a05bef6): created successfully
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09783934-c4d8-41db-8248-54c1c7f4f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Flow 'volume_create_manager' (be5004c2-8c80-4df4-900d-727e45117b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-60bd1b03-891d-43a6-951d-1b264e526b98 tempest-ServerActionsTestOtherA-697217619 None] Created volume successfully.
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Flow 'volume_create_manager' (be53a84d-90b9-425e-98c2-3210f8363827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c169207a-9e5b-4f74-be56-2b2b5f506908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c169207a-9e5b-4f74-be56-2b2b5f506908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-149664879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824c8a1c-5fb0-44ce-bfee-f10dcc918e6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8558fe1db864b5aab4fa92723b745dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:39Z,use_quota=True,user_id='2e40b3612ae541069654795cb15bb89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee307c2-1026-4dc0-94f4-33edbf91f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee307c2-1026-4dc0-94f4-33edbf91f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3be751-38e1-41e9-9627-dabdf88c87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3be751-38e1-41e9-9627-dabdf88c87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824c8a1c-5fb0-44ce-bfee-f10dcc918e6a', 'volume_name': 'volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243b92e-dfd3-4fc0-bcc1-e2c9ec2639d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243b92e-dfd3-4fc0-bcc1-e2c9ec2639d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29189d2b-23bc-47dc-a153-337cae451f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Volume 824c8a1c-5fb0-44ce-bfee-f10dcc918e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a', 'volume_size': 1}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-149664879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824c8a1c-5fb0-44ce-bfee-f10dcc918e6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8558fe1db864b5aab4fa92723b745dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:39Z,use_quota=True,user_id='2e40b3612ae541069654795cb15bb89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Creating volume 824c8a1c-5fb0-44ce-bfee-f10dcc918e6a {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:38 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:38 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a 1073741824
Sep 23 00:12:38 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:39 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a 1073741824" returned: 0 in 0.755s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:39 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a
Sep 23 00:12:39 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:40 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" returned: 0 in 0.501s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29189d2b-23bc-47dc-a153-337cae451f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d360075-c175-4c72-9405-678074fe8aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Volume volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a (824c8a1c-5fb0-44ce-bfee-f10dcc918e6a): created successfully
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d360075-c175-4c72-9405-678074fe8aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Flow 'volume_create_manager' (be53a84d-90b9-425e-98c2-3210f8363827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-14cbc262-6812-435e-bcd1-2f2727183a49 req-d0767ad3-4bba-433f-b05e-d6f6357cd8b6 tempest-VolumesGetTestJSON-1546585697 None] Created volume successfully.
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Flow 'volume_create_manager' (1b5aae49-e40b-41c0-8857-d9dcc93868c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2944d1d7-1eea-4d8b-bca8-815a69809987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2944d1d7-1eea-4d8b-bca8-815a69809987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-704068511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72014cd8-6080-499b-9584-d6f1e7a8ab34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500fb8e1a4c2483d92d2837d44414bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:40Z,use_quota=True,user_id='2bdf6cbd72b245a19659a7620824223f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e70607-a332-4898-85b7-0b2f0b7b3b32),volume_type_id=f0e70607-a332-4898-85b7-0b2f0b7b3b32)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d644da3d-1323-4f6a-a60f-ff441cce7610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d644da3d-1323-4f6a-a60f-ff441cce7610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629f387e-48a9-4e8f-988d-dc4d41d2d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629f387e-48a9-4e8f-988d-dc4d41d2d04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72014cd8-6080-499b-9584-d6f1e7a8ab34', 'volume_name': 'volume-72014cd8-6080-499b-9584-d6f1e7a8ab34', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037c56ca-79bf-4b9e-bdc2-869722fadf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037c56ca-79bf-4b9e-bdc2-869722fadf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e38706-3bc4-4617-a255-71d1c2bcd688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Volume 72014cd8-6080-499b-9584-d6f1e7a8ab34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72014cd8-6080-499b-9584-d6f1e7a8ab34', 'volume_size': 1}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-704068511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72014cd8-6080-499b-9584-d6f1e7a8ab34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500fb8e1a4c2483d92d2837d44414bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:40Z,use_quota=True,user_id='2bdf6cbd72b245a19659a7620824223f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e70607-a332-4898-85b7-0b2f0b7b3b32),volume_type_id=f0e70607-a332-4898-85b7-0b2f0b7b3b32)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Creating volume 72014cd8-6080-499b-9584-d6f1e7a8ab34 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:40 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:40 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 1073741824
Sep 23 00:12:40 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:41 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 1073741824" returned: 0 in 1.028s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:41 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34
Sep 23 00:12:41 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Acquiring lock "cinder-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "cinder-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Acquiring lock "cinder-quobyte-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "cinder-quobyte-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:42 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34" returned: 0 in 0.623s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e38706-3bc4-4617-a255-71d1c2bcd688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72014cd8-6080-499b-9584-d6f1e7a8ab34', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb846c-cb69-4051-afad-aa23bf412d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[73476c02-fc3e-48c8-a1d1-a6235604f5cd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Volume volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 (72014cd8-6080-499b-9584-d6f1e7a8ab34): created successfully
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb846c-cb69-4051-afad-aa23bf412d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Flow 'volume_create_manager' (1b5aae49-e40b-41c0-8857-d9dcc93868c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-66a6017a-d99d-45a1-b2a3-43339d25bdbf tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Created volume successfully.
Sep 23 00:12:42 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a
Sep 23 00:12:42 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:42 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" returned: 0 in 0.555s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:42 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a
Sep 23 00:12:42 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:43 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" returned: 0 in 0.650s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "cinder-quobyte-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a" released by "delete_volume" :: held 1.358s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG cinder.quota [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Created reservations ['f47e073e-4955-41c3-9206-92268721b426', 'b0ae1a51-4f81-4e8f-acac-fa20af20ccf8', 'd2e40e3c-bd0c-4f0b-9400-e598885b906f', 'ddc3e72a-7ac0-4424-b06a-448bc7b2f66f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:44 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:44 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:44 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.711s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG cinder.manager [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Deleted volume successfully.
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-dd844f7e-1f27-456d-9486-9ae2ce1072ed req-1d8ee341-8fe8-4546-b08e-164daeee11ae tempest-VolumesGetTestJSON-1546585697 None] Lock "cinder-824c8a1c-5fb0-44ce-bfee-f10dcc918e6a-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:44 devstack sudo[90130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:44 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:45 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.408s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:45 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-249f4505-4f03-4c4c-97a8-2684ba28be6d tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Retype volume completed successfully.
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "cinder-72014cd8-6080-499b-9584-d6f1e7a8ab34-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "cinder-72014cd8-6080-499b-9584-d6f1e7a8ab34-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "cinder-quobyte-72014cd8-6080-499b-9584-d6f1e7a8ab34" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "cinder-quobyte-72014cd8-6080-499b-9584-d6f1e7a8ab34" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b98d5c-556b-4f68-b748-1af75ac2ed31]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:12:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:46 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34
Sep 23 00:12:46 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:47 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34" returned: 0 in 0.714s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:47 devstack sudo[90139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34
Sep 23 00:12:47 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:47 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-72014cd8-6080-499b-9584-d6f1e7a8ab34" returned: 0 in 0.521s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "cinder-quobyte-72014cd8-6080-499b-9584-d6f1e7a8ab34" released by "delete_volume" :: held 1.378s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:47 devstack cinder-volume[86631]: WARNING cinder.quota [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:47 devstack cinder-volume[86631]: WARNING cinder.quota [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Created reservations ['d66e899a-c32c-4535-912c-e347505d59a3', '23922aad-4548-4d5c-a137-9358a248c6c9', '1257e42c-8b0d-4fd0-9149-de21435f45ac', 'c2fa2242-0c68-424f-ad7c-af0099383aeb'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:47 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:47 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:48 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.358s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:48 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Deleted volume successfully.
Sep 23 00:12:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b7e7d51f-4eec-41bf-9441-f2ac3e9959d5 tempest-VolumeRetypeWithoutMigrationTest-1741881864 None] Lock "cinder-72014cd8-6080-499b-9584-d6f1e7a8ab34-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (4188bc45-f510-44f1-a9a8-8a3b96af3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c06bcd6-a7e9-4e89-92b5-2e84d2a5250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c06bcd6-a7e9-4e89-92b5-2e84d2a5250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1897974741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188236c4-b753-4f14-8c05-5d520a2bb813,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:54Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3fc97a-2ab3-419a-bc42-f9d508190855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3fc97a-2ab3-419a-bc42-f9d508190855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aa5516-4c4b-455c-bfe6-278efeb60018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aa5516-4c4b-455c-bfe6-278efeb60018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188236c4-b753-4f14-8c05-5d520a2bb813', 'volume_name': 'volume-188236c4-b753-4f14-8c05-5d520a2bb813', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98469fa4-e262-4ec1-af25-3d8fa0abab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98469fa4-e262-4ec1-af25-3d8fa0abab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f96d65-9a2b-4c4b-ae40-0659254363b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:53 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Volume 188236c4-b753-4f14-8c05-5d520a2bb813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188236c4-b753-4f14-8c05-5d520a2bb813', 'volume_size': 1}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1897974741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188236c4-b753-4f14-8c05-5d520a2bb813,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:54Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Creating volume 188236c4-b753-4f14-8c05-5d520a2bb813 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:53 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:53 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 1073741824
Sep 23 00:12:53 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:54 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 1073741824" returned: 0 in 0.836s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:54 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813
Sep 23 00:12:54 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:55 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813" returned: 0 in 0.592s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f96d65-9a2b-4c4b-ae40-0659254363b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188236c4-b753-4f14-8c05-5d520a2bb813', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8c0645-291a-4d5b-96ae-b390bc593256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:55 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Volume volume-188236c4-b753-4f14-8c05-5d520a2bb813 (188236c4-b753-4f14-8c05-5d520a2bb813): created successfully
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8c0645-291a-4d5b-96ae-b390bc593256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (4188bc45-f510-44f1-a9a8-8a3b96af3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-444db080-e573-48fe-897b-0f6a1efa5ec8 tempest-VolumesTestJSON-205342618 None] Created volume successfully.
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:57 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:12:57 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:12:57 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (a77b476c-3f9a-4aa9-8f9d-66f3d664ab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3a90aa-6c31-44f2-97a4-f68779c12a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.536s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3a90aa-6c31-44f2-97a4-f68779c12a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476735517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2407c5c6-dfd7-4273-a515-5bb224e6100c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:57Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2195bd-1b80-47de-a327-e8ce5de69ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2195bd-1b80-47de-a327-e8ce5de69ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272e446d-7452-4ce2-9ecc-20fe809e7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272e446d-7452-4ce2-9ecc-20fe809e7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2407c5c6-dfd7-4273-a515-5bb224e6100c', 'volume_name': 'volume-2407c5c6-dfd7-4273-a515-5bb224e6100c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62ec649-1715-4dc1-8907-921dda3975b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62ec649-1715-4dc1-8907-921dda3975b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c98c1c2-0530-4025-83a7-bc21619ce2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:57 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Volume 2407c5c6-dfd7-4273-a515-5bb224e6100c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2407c5c6-dfd7-4273-a515-5bb224e6100c', 'volume_size': 1}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476735517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2407c5c6-dfd7-4273-a515-5bb224e6100c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:57Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Creating volume 2407c5c6-dfd7-4273-a515-5bb224e6100c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:12:57 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:12:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:57 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c 1073741824
Sep 23 00:12:57 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:58 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c 1073741824" returned: 0 in 0.840s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:12:58 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c
Sep 23 00:12:58 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:12:58 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c" returned: 0 in 0.347s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c98c1c2-0530-4025-83a7-bc21619ce2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2407c5c6-dfd7-4273-a515-5bb224e6100c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0cf7bb-7800-4f5e-8de0-05c0302e4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:12:58 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Volume volume-2407c5c6-dfd7-4273-a515-5bb224e6100c (2407c5c6-dfd7-4273-a515-5bb224e6100c): created successfully
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0cf7bb-7800-4f5e-8de0-05c0302e4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:12:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (a77b476c-3f9a-4aa9-8f9d-66f3d664ab63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:12:58 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e20aec5f-bacc-46ea-aa74-ce38a0aa17c8 tempest-VolumesTestJSON-205342618 None] Created volume successfully.
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (d86f7547-96bc-44e7-9b68-71b76e30c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e25d8-f629-48d6-b441-246debbaf14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e25d8-f629-48d6-b441-246debbaf14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486840299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab45ffa7-37b9-4af7-af5e-3ae11311dce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:00Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2f5cdd-9b9f-46f6-8e3d-b7d621f1cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2f5cdd-9b9f-46f6-8e3d-b7d621f1cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2b1951-b2d0-4953-9f82-84012fb4f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2b1951-b2d0-4953-9f82-84012fb4f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab45ffa7-37b9-4af7-af5e-3ae11311dce7', 'volume_name': 'volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e90987-9886-43a3-92ac-727b3bd3bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e90987-9886-43a3-92ac-727b3bd3bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8841cd5-d969-41e1-a4bc-88fc2d3629b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:00 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Volume ab45ffa7-37b9-4af7-af5e-3ae11311dce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7', 'volume_size': 1}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486840299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab45ffa7-37b9-4af7-af5e-3ae11311dce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d9adbb02b4970aca76232b935c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:00Z,use_quota=True,user_id='fa99f07c6fbb4445b3af710e6829779f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Creating volume ab45ffa7-37b9-4af7-af5e-3ae11311dce7 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:00 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:00 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 1073741824
Sep 23 00:13:00 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:01 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 1073741824" returned: 0 in 0.621s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:01 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7
Sep 23 00:13:01 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Flow 'volume_create_manager' (ae880d10-a2d4-4310-ab73-58ff8e1379c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa6f31a-ce41-4c20-ac53-95821b4952d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa6f31a-ce41-4c20-ac53-95821b4952d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-783004735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec89fd-b191-4aae-8780-2c0787571729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36e6d9ece1a4b8588006f7812f63a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:01Z,use_quota=True,user_id='7f8c183674b845b0ad299bd030af5555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c4150-eada-450d-ab3e-10adde021f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c4150-eada-450d-ab3e-10adde021f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7496c0-4c81-4097-a63f-236a33e575b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7496c0-4c81-4097-a63f-236a33e575b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ec89fd-b191-4aae-8780-2c0787571729', 'volume_name': 'volume-c0ec89fd-b191-4aae-8780-2c0787571729', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd58cfc9-49cc-4c53-a90a-552a767087d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd58cfc9-49cc-4c53-a90a-552a767087d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f698a966-e250-4250-9ef7-7f464a29f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Volume c0ec89fd-b191-4aae-8780-2c0787571729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ec89fd-b191-4aae-8780-2c0787571729', 'volume_size': 1}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:01 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" returned: 0 in 0.326s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-783004735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec89fd-b191-4aae-8780-2c0787571729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36e6d9ece1a4b8588006f7812f63a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:01Z,use_quota=True,user_id='7f8c183674b845b0ad299bd030af5555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Creating volume c0ec89fd-b191-4aae-8780-2c0787571729 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:01 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8841cd5-d969-41e1-a4bc-88fc2d3629b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aa31b4-6302-49d0-b41f-468e073fa60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:01 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 1073741824
Sep 23 00:13:01 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Volume volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 (ab45ffa7-37b9-4af7-af5e-3ae11311dce7): created successfully
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aa31b4-6302-49d0-b41f-468e073fa60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Flow 'volume_create_manager' (d86f7547-96bc-44e7-9b68-71b76e30c068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2056e60e-b1b1-4a14-9359-642088cba912 tempest-VolumesTestJSON-205342618 None] Created volume successfully.
Sep 23 00:13:02 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 1073741824" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:02 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729
Sep 23 00:13:02 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:02 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f698a966-e250-4250-9ef7-7f464a29f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ec89fd-b191-4aae-8780-2c0787571729', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8525a0-5679-4c92-a9ce-3c5d84bbc234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Volume volume-c0ec89fd-b191-4aae-8780-2c0787571729 (c0ec89fd-b191-4aae-8780-2c0787571729): created successfully
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8525a0-5679-4c92-a9ce-3c5d84bbc234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Flow 'volume_create_manager' (ae880d10-a2d4-4310-ab73-58ff8e1379c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ed6f0049-80ba-4540-a075-2dab29dac13b tempest-VolumesServicesTestJSON-59780727 None] Created volume successfully.
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Acquiring lock "cinder-c0ec89fd-b191-4aae-8780-2c0787571729-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-ab45ffa7-37b9-4af7-af5e-3ae11311dce7-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "cinder-c0ec89fd-b191-4aae-8780-2c0787571729-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "cinder-ab45ffa7-37b9-4af7-af5e-3ae11311dce7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Acquiring lock "cinder-quobyte-c0ec89fd-b191-4aae-8780-2c0787571729" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "cinder-quobyte-c0ec89fd-b191-4aae-8780-2c0787571729" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-quobyte-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ac933-6ef9-40d2-b5ee-65dae8fa5fe6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1cff19-af88-437b-9cc8-7d5267698943]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:04 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7
Sep 23 00:13:04 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:04 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729
Sep 23 00:13:04 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:04 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" returned: 0 in 0.490s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:04 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:04 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7
Sep 23 00:13:04 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729" returned: 0 in 0.547s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:04 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729
Sep 23 00:13:04 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:04 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" returned: 0 in 0.359s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:04 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c0ec89fd-b191-4aae-8780-2c0787571729" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-ab45ffa7-37b9-4af7-af5e-3ae11311dce7" released by "delete_volume" :: held 0.913s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "cinder-quobyte-c0ec89fd-b191-4aae-8780-2c0787571729" released by "delete_volume" :: held 0.971s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Created reservations ['d051f61c-b869-4714-8b78-f2c4fc9cafec', '6cbfcd1a-2511-4f16-aa30-f31458def9ae', '9f2108e5-de23-4571-8988-576ab469d115', '5b36566c-3c3e-4146-b3da-f85328a4abfa'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:04 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Created reservations ['e3c78359-1151-4a7a-aa39-d6f3cc0f8737', '418dc5d8-406d-4f5b-965f-5064b26dd5c7', '307ce42c-370f-41ae-9ef8-7dda58ef527e', '74577afb-b03f-463e-81bc-5bb6bdf0df58'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:05 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:05 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:05 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:05 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:05 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Deleted volume successfully.
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1153c816-1744-480b-bf94-d4ac5e17dbf6 tempest-VolumesTestJSON-205342618 None] Lock "cinder-ab45ffa7-37b9-4af7-af5e-3ae11311dce7-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:05 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.330s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Deleted volume successfully.
Sep 23 00:13:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6125637d-a60c-43e8-8e83-106562a05a9a tempest-VolumesServicesTestJSON-59780727 None] Lock "cinder-c0ec89fd-b191-4aae-8780-2c0787571729-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-2407c5c6-dfd7-4273-a515-5bb224e6100c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "cinder-2407c5c6-dfd7-4273-a515-5bb224e6100c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-quobyte-2407c5c6-dfd7-4273-a515-5bb224e6100c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-2407c5c6-dfd7-4273-a515-5bb224e6100c" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b2fd2-3639-4000-9b5e-78e75971888a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:06 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c
Sep 23 00:13:06 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:06 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c" returned: 0 in 0.588s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:06 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c
Sep 23 00:13:06 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:07 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2407c5c6-dfd7-4273-a515-5bb224e6100c" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-2407c5c6-dfd7-4273-a515-5bb224e6100c" released by "delete_volume" :: held 1.001s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Created reservations ['7fe61be5-3ff3-4354-961d-ac14e1712fa1', 'cb6d8d8a-5319-49e2-849f-57d79e9c5019', '90cf46fe-1738-4a25-ae0b-24474a25c99d', '021f355b-7376-4ea8-8d66-5936caad1adf'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:07 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:07 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:08 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.502s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Deleted volume successfully.
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a5aca035-82f0-4983-9afa-867f0a78780f tempest-VolumesTestJSON-205342618 None] Lock "cinder-2407c5c6-dfd7-4273-a515-5bb224e6100c-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-188236c4-b753-4f14-8c05-5d520a2bb813-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "cinder-188236c4-b753-4f14-8c05-5d520a2bb813-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Acquiring lock "cinder-quobyte-188236c4-b753-4f14-8c05-5d520a2bb813" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-188236c4-b753-4f14-8c05-5d520a2bb813" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c3a7d-4328-4388-8f10-0952bdd4a025]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:08 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813
Sep 23 00:13:08 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:09 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813" returned: 0 in 0.584s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:09 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813
Sep 23 00:13:09 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:09 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-188236c4-b753-4f14-8c05-5d520a2bb813" returned: 0 in 0.378s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "cinder-quobyte-188236c4-b753-4f14-8c05-5d520a2bb813" released by "delete_volume" :: held 1.042s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Created reservations ['3f502f06-b79a-4f8a-8efb-ee9aa4270f87', '6606ac87-1983-46b3-8b37-7be79b8fe780', '3524d410-0327-4f3e-8ab7-f6937896b554', '5646a81d-6ead-42e6-95de-1fb886c500fe'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:10 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:10 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:10 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:10 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Deleted volume successfully.
Sep 23 00:13:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ae33193e-3dc9-44c2-ac40-f9ffd36d9012 tempest-VolumesTestJSON-205342618 None] Lock "cinder-188236c4-b753-4f14-8c05-5d520a2bb813-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-44de30ad-0dfc-43de-b6ce-f4c3d7a0f4d4 tempest-GroupSnapshotsV319Test-755092629 None] Group tempest-GroupSnapshotsV319Test-Group-1472479474: creating
Sep 23 00:13:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-44de30ad-0dfc-43de-b6ce-f4c3d7a0f4d4 tempest-GroupSnapshotsV319Test-755092629 None] Group tempest-GroupSnapshotsV319Test-Group-1472479474: created successfully
Sep 23 00:13:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-44de30ad-0dfc-43de-b6ce-f4c3d7a0f4d4 tempest-GroupSnapshotsV319Test-755092629 None] Create group completed successfully.
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Flow 'volume_create_manager' (b4cc34b5-af46-431a-9bf3-266f565c5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5562fae9-437c-45d1-a4ac-2f170201d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5562fae9-437c-45d1-a4ac-2f170201d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184969926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c447b959-3b13-47f1-9bc6-3c72660c11b8,host='devstack@QuobyteHD#QuobyteHD',id=7276d241-b141-431f-b236-ef3451b27a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fd7eb3925d4f31b7fb55bbc1c2c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:19Z,use_quota=True,user_id='c41b658e59db489f95f45c5cdfaaa99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42c937f6-2466-4753-a59d-ac81adb010ac),volume_type_id=42c937f6-2466-4753-a59d-ac81adb010ac)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997d1090-b05b-49ae-9f24-a0dc81fd5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997d1090-b05b-49ae-9f24-a0dc81fd5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be0d96-7867-4296-a304-a5febc44c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be0d96-7867-4296-a304-a5febc44c237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7276d241-b141-431f-b236-ef3451b27a92', 'volume_name': 'volume-7276d241-b141-431f-b236-ef3451b27a92', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0098c5b-2aa0-40e1-ac2c-60db4f1b7733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0098c5b-2aa0-40e1-ac2c-60db4f1b7733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec0f59a-51e5-444e-a29a-70f9e59679ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Volume 7276d241-b141-431f-b236-ef3451b27a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7276d241-b141-431f-b236-ef3451b27a92', 'volume_size': 1}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c447b959-3b13-47f1-9bc6-3c72660c11b8,created_at=2026-09-22T22:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184969926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c447b959-3b13-47f1-9bc6-3c72660c11b8,host='devstack@QuobyteHD#QuobyteHD',id=7276d241-b141-431f-b236-ef3451b27a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fd7eb3925d4f31b7fb55bbc1c2c997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:19Z,use_quota=True,user_id='c41b658e59db489f95f45c5cdfaaa99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42c937f6-2466-4753-a59d-ac81adb010ac),volume_type_id=42c937f6-2466-4753-a59d-ac81adb010ac)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Creating volume 7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:19 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 1073741824
Sep 23 00:13:19 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:20 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 1073741824" returned: 0 in 0.557s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:20 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92
Sep 23 00:13:20 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:20 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec0f59a-51e5-444e-a29a-70f9e59679ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7276d241-b141-431f-b236-ef3451b27a92', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f101ea41-6964-4ee6-82d9-2c9a08eebdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Volume volume-7276d241-b141-431f-b236-ef3451b27a92 (7276d241-b141-431f-b236-ef3451b27a92): created successfully
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f101ea41-6964-4ee6-82d9-2c9a08eebdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Flow 'volume_create_manager' (b4cc34b5-af46-431a-9bf3-266f565c5b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f0ed4459-0dfc-47b2-a11a-ea9cf78eedeb tempest-GroupSnapshotsV319Test-755092629 None] Created volume successfully.
Sep 23 00:13:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] GroupSnapshot 5424c01f-97ac-446f-bc25-deb113df1fde: creating.
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Group snapshot 5424c01f-97ac-446f-bc25-deb113df1fde: creating. {{(pid=86631) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Creating offline snapshot 6c2ba5e8-803f-49b9-8642-745ccc17c476 of volume 7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84532a7-9edb-40e5-a9a5-5c3d4c421717]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:21 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92
Sep 23 00:13:21 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:21 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:21 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 1G
Sep 23 00:13:21 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:21 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 1G" returned: 0 in 0.590s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7276d241-b141-431f-b236-ef3451b27a92 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:22 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7276d241-b141-431f-b236-ef3451b27a92 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476
Sep 23 00:13:22 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:22 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7276d241-b141-431f-b236-ef3451b27a92 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476" returned: 0 in 0.434s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:13:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:22 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476
Sep 23 00:13:22 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:22 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:22 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=73,cinder:UPDATE=89,cinder:INSERT=17,cinder:DELETE=9 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:13:22 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=71,cinder:UPDATE=97,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:13:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:23 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info
Sep 23 00:13:23 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:23 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:13:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:23 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info
Sep 23 00:13:23 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:23 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.info" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:23 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6f64ea0f-7061-49f7-beee-372918cefb88 tempest-GroupSnapshotsV319Test-755092629 None] group_snapshot 5424c01f-97ac-446f-bc25-deb113df1fde: created successfully
Sep 23 00:13:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] group_snapshot 5424c01f-97ac-446f-bc25-deb113df1fde: deleting
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] group_snapshot 5424c01f-97ac-446f-bc25-deb113df1fde: deleting {{(pid=86631) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "cinder-quobyte-6c2ba5e8-803f-49b9-8642-745ccc17c476" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-6c2ba5e8-803f-49b9-8642-745ccc17c476" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Deleting offline snapshot 6c2ba5e8-803f-49b9-8642-745ccc17c476 of volume 7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] snapshot_file for this snap is: volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[99021e86-b8f2-410d-85cc-68f5b328ba92]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:25 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476
Sep 23 00:13:25 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:25 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476" returned: 0 in 0.647s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7276d241-b141-431f-b236-ef3451b27a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:13:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb55dc-f9f4-4380-bc5b-e8b772975ad3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:25 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92
Sep 23 00:13:25 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:26 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92" returned: 0 in 0.501s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:26 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476
Sep 23 00:13:26 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:26 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476" returned: 0 in 0.552s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:26 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476
Sep 23 00:13:26 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:27 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92.6c2ba5e8-803f-49b9-8642-745ccc17c476" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-6c2ba5e8-803f-49b9-8642-745ccc17c476" released by "_delete_snapshot" :: held 2.264s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" released by "delete_snapshot" :: held 2.302s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:27 devstack cinder-volume[86631]: WARNING cinder.quota [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-129896514 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-129896514, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:13:27 devstack cinder-volume[86631]: WARNING cinder.quota [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-129896514 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-129896514, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] Created reservations ['9c01741e-e0a6-4e03-88dd-e35e6842cb75', '2546dd55-8610-4c4a-8286-490b8eff823b', 'a83ebcab-afa8-4858-b29d-bb5fb0582d46', 'b9f1163a-be74-43d2-9dc2-fb9e80a1d0a1'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-38f2993d-7958-4ac4-884e-5420c2f1aa02 tempest-GroupSnapshotsV319Test-755092629 None] group_snapshot 5424c01f-97ac-446f-bc25-deb113df1fde: deleted successfully
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Acquiring lock "cinder-3a119537-5b45-4456-8205-ce041a9dbd5b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "cinder-3a119537-5b45-4456-8205-ce041a9dbd5b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Acquiring lock "cinder-quobyte-3a119537-5b45-4456-8205-ce041a9dbd5b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "cinder-quobyte-3a119537-5b45-4456-8205-ce041a9dbd5b" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[770bae44-8f6e-4ece-b7ed-cdbc1fa242ec]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:28 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b
Sep 23 00:13:28 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:28 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b" returned: 0 in 0.501s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:28 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b
Sep 23 00:13:28 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77b589-56c8-4c81-8e74-ada27a376aa9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:28 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3a119537-5b45-4456-8205-ce041a9dbd5b" returned: 0 in 0.335s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "cinder-quobyte-3a119537-5b45-4456-8205-ce041a9dbd5b" released by "delete_volume" :: held 0.901s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Created reservations ['a33e2c0a-74a2-42b1-86df-6ffa33338e15', '2afdacd3-631e-4b5f-bd38-2cef59e56d4e', '254f0b4b-5d86-4273-9d67-3e78947af280', 'a464db7e-0f20-4faf-aad5-7d2f680341b4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:28 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92
Sep 23 00:13:28 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:28 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:28 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:29 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92" returned: 0 in 0.606s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:29 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92
Sep 23 00:13:29 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:29 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Deleted volume successfully.
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70794b1-80f1-4fb2-9e55-d3ace6742ca7 tempest-AttachVolumeShelveTestJSON-1347846063 None] Lock "cinder-3a119537-5b45-4456-8205-ce041a9dbd5b-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:29 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7276d241-b141-431f-b236-ef3451b27a92" returned: 0 in 0.338s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Lock "cinder-quobyte-7276d241-b141-431f-b236-ef3451b27a92" released by "delete_volume" :: held 1.065s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Created reservations ['42c01f19-4683-407a-bedf-10ec36f99c8a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:29 devstack cinder-volume[86631]: WARNING cinder.quota [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-129896514 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-129896514, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:13:29 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Created reservations ['6b21aa83-d949-407f-a9c2-e2fcae4a6d12', '25a16406-7d9a-4529-bb53-95639f3306a3', '1b94e8e1-985f-49cc-bc6b-faaaec5e03f7', 'fe548eac-d4b0-44c6-8356-55f4f5ba4f8f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:30 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:30 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:30 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.436s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:30 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-92fa69f2-8125-455a-9bd6-7c74771cef53 tempest-GroupSnapshotsV319Test-755092629 None] Delete group completed successfully.
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Flow 'volume_create_manager' (b7104a06-807d-49b9-9f91-2212f6eb31d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b1b73e-c006-4b2d-8480-b0172a258e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b1b73e-c006-4b2d-8480-b0172a258e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-116514947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dfe7fe-b178-4575-abe5-d67b8578b61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4ed810453f4c14be232f021599e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:32Z,use_quota=True,user_id='3f1149a96308441f9cbf9e17a1483fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d4c383-63c9-445a-9031-e9457b8f12b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d4c383-63c9-445a-9031-e9457b8f12b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97914f64-c2dc-427c-969a-5467b5ae44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97914f64-c2dc-427c-969a-5467b5ae44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dfe7fe-b178-4575-abe5-d67b8578b61c', 'volume_name': 'volume-73dfe7fe-b178-4575-abe5-d67b8578b61c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033be7e4-f5d9-4b8c-b8c6-f4da5b1751aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033be7e4-f5d9-4b8c-b8c6-f4da5b1751aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3f3e20-f2d9-4a53-8b99-598c5be8a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Volume 73dfe7fe-b178-4575-abe5-d67b8578b61c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dfe7fe-b178-4575-abe5-d67b8578b61c', 'volume_size': 1}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-116514947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dfe7fe-b178-4575-abe5-d67b8578b61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4ed810453f4c14be232f021599e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:32Z,use_quota=True,user_id='3f1149a96308441f9cbf9e17a1483fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Creating volume 73dfe7fe-b178-4575-abe5-d67b8578b61c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:32 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:32 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c 1073741824
Sep 23 00:13:32 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:32 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c 1073741824" returned: 0 in 0.631s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:33 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c
Sep 23 00:13:33 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:33 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c" returned: 0 in 0.384s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3f3e20-f2d9-4a53-8b99-598c5be8a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dfe7fe-b178-4575-abe5-d67b8578b61c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c7bec7-5475-4e21-92e7-11f08058eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Volume volume-73dfe7fe-b178-4575-abe5-d67b8578b61c (73dfe7fe-b178-4575-abe5-d67b8578b61c): created successfully
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c7bec7-5475-4e21-92e7-11f08058eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Flow 'volume_create_manager' (b7104a06-807d-49b9-9f91-2212f6eb31d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b0541acf-ff00-4a1a-a010-3adaa434e945 tempest-AbsoluteLimitsTests-257945768 None] Created volume successfully.
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Acquiring lock "cinder-73dfe7fe-b178-4575-abe5-d67b8578b61c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "cinder-73dfe7fe-b178-4575-abe5-d67b8578b61c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Acquiring lock "cinder-quobyte-73dfe7fe-b178-4575-abe5-d67b8578b61c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "cinder-quobyte-73dfe7fe-b178-4575-abe5-d67b8578b61c" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644c210-608d-43b6-ad30-a3ca05560a3f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:35 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c
Sep 23 00:13:35 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1c9ffe5b-5160-4d6c-a332-f77c4bd23211 req-6e64c759-3b9d-4b7f-9949-8c8f41cdec27 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1c9ffe5b-5160-4d6c-a332-f77c4bd23211 req-6e64c759-3b9d-4b7f-9949-8c8f41cdec27 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1c9ffe5b-5160-4d6c-a332-f77c4bd23211 req-6e64c759-3b9d-4b7f-9949-8c8f41cdec27 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-1c9ffe5b-5160-4d6c-a332-f77c4bd23211 req-6e64c759-3b9d-4b7f-9949-8c8f41cdec27 tempest-ServerActionsTestOtherA-697217619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-56adc4a0-d443-4a34-9b4f-31724a05bef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88de61c0-1c47-4563-b95d-dafa69d33cb5', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:13:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-1c9ffe5b-5160-4d6c-a332-f77c4bd23211 req-6e64c759-3b9d-4b7f-9949-8c8f41cdec27 tempest-ServerActionsTestOtherA-697217619 None] attachment_update completed successfully.
Sep 23 00:13:36 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c" returned: 0 in 0.701s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:36 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c
Sep 23 00:13:36 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:36 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73dfe7fe-b178-4575-abe5-d67b8578b61c" returned: 0 in 0.510s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "cinder-quobyte-73dfe7fe-b178-4575-abe5-d67b8578b61c" released by "delete_volume" :: held 1.298s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:36 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Created reservations ['ff6e675b-c351-4a51-8a5a-b250dcb846ad', 'a0f1861a-d6f2-47d4-a0e6-42736e42f293', '97320dec-fb7f-4a9c-a49f-d873b5474255', 'be1b8610-6f65-43a1-9a4d-4b929b1a8854'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:37 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:37 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:37 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.463s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Deleted volume successfully.
Sep 23 00:13:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a4a87d65-98ea-4ca7-aebf-640138d3cfa3 tempest-AbsoluteLimitsTests-257945768 None] Lock "cinder-73dfe7fe-b178-4575-abe5-d67b8578b61c-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7f69021f-1306-4bd8-9035-894bf93833ef req-bc2de495-7a42-4e51-91f2-3d05ff003b9c tempest-ServerActionsTestOtherA-697217619 None] Terminate volume connection completed successfully.
Sep 23 00:13:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7f69021f-1306-4bd8-9035-894bf93833ef req-bc2de495-7a42-4e51-91f2-3d05ff003b9c tempest-ServerActionsTestOtherA-697217619 None] Deleting attachment 88de61c0-1c47-4563-b95d-dafa69d33cb5. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:13:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7f69021f-1306-4bd8-9035-894bf93833ef req-e37bda5e-8b25-462b-8385-416ffd621c9c tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7f69021f-1306-4bd8-9035-894bf93833ef req-e37bda5e-8b25-462b-8385-416ffd621c9c tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7f69021f-1306-4bd8-9035-894bf93833ef req-e37bda5e-8b25-462b-8385-416ffd621c9c tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7f69021f-1306-4bd8-9035-894bf93833ef req-e37bda5e-8b25-462b-8385-416ffd621c9c tempest-ServerActionsTestOtherA-697217619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-56adc4a0-d443-4a34-9b4f-31724a05bef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76160bef-4c2f-4d07-b998-b48547cc0568', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:13:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7f69021f-1306-4bd8-9035-894bf93833ef req-e37bda5e-8b25-462b-8385-416ffd621c9c tempest-ServerActionsTestOtherA-697217619 None] attachment_update completed successfully.
Sep 23 00:13:51 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=48,cinder:INSERT=11,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:13:51 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=41,cinder:UPDATE=45,cinder:INSERT=8 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Flow 'volume_create_manager' (e4ee97a9-eaa6-450c-afd7-c5200fae9cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5509c0-e257-47c9-8557-1f441f415831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5509c0-e257-47c9-8557-1f441f415831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-473158642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033fa408-06fb-4a1c-8fc3-e87e54d62b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d2e6a3b2fb4d70887d78ed76073f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:52Z,use_quota=True,user_id='34d1315421714a6a8e93494cc21ad67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3324c3-daba-4b3a-905a-27a5d41c4dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3324c3-daba-4b3a-905a-27a5d41c4dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6fadcd-d557-4f40-9df4-aefde92b5871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6fadcd-d557-4f40-9df4-aefde92b5871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '033fa408-06fb-4a1c-8fc3-e87e54d62b80', 'volume_name': 'volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c16f07-2f43-4d9d-be63-e03e2f5d282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c16f07-2f43-4d9d-be63-e03e2f5d282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2fb343-2801-417f-8b7e-54b6aa1cb559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:52 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Volume 033fa408-06fb-4a1c-8fc3-e87e54d62b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80', 'volume_size': 1}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-473158642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033fa408-06fb-4a1c-8fc3-e87e54d62b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d2e6a3b2fb4d70887d78ed76073f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:52Z,use_quota=True,user_id='34d1315421714a6a8e93494cc21ad67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Creating volume 033fa408-06fb-4a1c-8fc3-e87e54d62b80 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:52 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:52 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 1073741824
Sep 23 00:13:52 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:53 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 1073741824" returned: 0 in 0.968s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:53 devstack sudo[91511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80
Sep 23 00:13:53 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:54 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80" returned: 0 in 0.603s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2fb343-2801-417f-8b7e-54b6aa1cb559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea724c62-e414-49dc-98fb-63e3d5f0c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:54 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Volume volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 (033fa408-06fb-4a1c-8fc3-e87e54d62b80): created successfully
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea724c62-e414-49dc-98fb-63e3d5f0c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Flow 'volume_create_manager' (e4ee97a9-eaa6-450c-afd7-c5200fae9cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c1a7b5e7-e1ae-460a-b38c-c4725a56d64a tempest-VolumesTransfersV355Test-1626781291 None] Created volume successfully.
Sep 23 00:13:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-433473ba-590e-49f8-b48a-5c69cfd48e00 tempest-VolumesTransfersV355Test-1598225536 None] Transfer volume completed successfully.
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:56 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:56 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:57 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.526s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 8 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Flow 'volume_create_manager' (506c65b8-8379-4134-97c3-bda008ce2e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaa44c8-045c-438f-bbeb-13fa687e52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaa44c8-045c-438f-bbeb-13fa687e52e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1126365879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0efae6e-2c85-4bec-8c24-e83298bf9423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb0eed99a424870899e0a28d4aa4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:58Z,use_quota=True,user_id='45dccf937c294df0b1dcddfd25267269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4525af85-fc11-4f1c-ac8b-ce0b7f0c4359),volume_type_id=4525af85-fc11-4f1c-ac8b-ce0b7f0c4359)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5f8ae-41cf-44f2-b813-1c7fab053bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5f8ae-41cf-44f2-b813-1c7fab053bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2a15c0-8747-4d1a-9134-0fa2566128d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2a15c0-8747-4d1a-9134-0fa2566128d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0efae6e-2c85-4bec-8c24-e83298bf9423', 'volume_name': 'volume-d0efae6e-2c85-4bec-8c24-e83298bf9423', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a384d1-bae0-41cb-b06c-956618b61525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a384d1-bae0-41cb-b06c-956618b61525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790eba61-fd24-4444-82ff-08443cb4b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:57 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Volume d0efae6e-2c85-4bec-8c24-e83298bf9423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0efae6e-2c85-4bec-8c24-e83298bf9423', 'volume_size': 1}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1126365879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0efae6e-2c85-4bec-8c24-e83298bf9423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb0eed99a424870899e0a28d4aa4377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:58Z,use_quota=True,user_id='45dccf937c294df0b1dcddfd25267269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4525af85-fc11-4f1c-ac8b-ce0b7f0c4359),volume_type_id=4525af85-fc11-4f1c-ac8b-ce0b7f0c4359)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Creating volume d0efae6e-2c85-4bec-8c24-e83298bf9423 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:13:57 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "cinder-033fa408-06fb-4a1c-8fc3-e87e54d62b80-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-033fa408-06fb-4a1c-8fc3-e87e54d62b80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:57 devstack sudo[91518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 1073741824
Sep 23 00:13:57 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "cinder-quobyte-033fa408-06fb-4a1c-8fc3-e87e54d62b80" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-quobyte-033fa408-06fb-4a1c-8fc3-e87e54d62b80" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f3697-58c4-40e6-90f0-380c6fc87f27]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:58 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80
Sep 23 00:13:58 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:58 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80" returned: 0 in 0.536s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:58 devstack sudo[91529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80
Sep 23 00:13:58 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:58 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 1073741824" returned: 0 in 0.743s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:58 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423
Sep 23 00:13:58 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:58 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-033fa408-06fb-4a1c-8fc3-e87e54d62b80" returned: 0 in 0.434s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-quobyte-033fa408-06fb-4a1c-8fc3-e87e54d62b80" released by "delete_volume" :: held 1.041s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Created reservations ['69fa0dd2-f98d-43b2-a624-fa83f87e7605', 'fa045690-39b5-4987-8c4f-89533affa4fa', '09febd16-ddec-4ac4-8a5a-35bafea3a12b', '9cfc8d0c-85d9-4717-8557-dd25200a9b12'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:13:59 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423" returned: 0 in 0.500s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790eba61-fd24-4444-82ff-08443cb4b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0efae6e-2c85-4bec-8c24-e83298bf9423', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0c55fd-8667-4d5a-997f-672da7affaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:13:59 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Volume volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 (d0efae6e-2c85-4bec-8c24-e83298bf9423): created successfully
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0c55fd-8667-4d5a-997f-672da7affaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Flow 'volume_create_manager' (506c65b8-8379-4134-97c3-bda008ce2e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:13:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-35b19107-2706-4190-8777-18aef5f8f8e5 tempest-VolumeTypesAccessTest-1519547530 None] Created volume successfully.
Sep 23 00:13:59 devstack sudo[91535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:13:59 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:13:59 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.435s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:13:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Deleted volume successfully.
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-75abf7e2-df39-4604-a0aa-a377105fbb5a tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-033fa408-06fb-4a1c-8fc3-e87e54d62b80-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Acquiring lock "cinder-d0efae6e-2c85-4bec-8c24-e83298bf9423-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:13:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "cinder-d0efae6e-2c85-4bec-8c24-e83298bf9423-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Acquiring lock "cinder-quobyte-d0efae6e-2c85-4bec-8c24-e83298bf9423" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "cinder-quobyte-d0efae6e-2c85-4bec-8c24-e83298bf9423" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c038e8-bade-432e-8cda-d815aeb253b8]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:00 devstack sudo[91539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423
Sep 23 00:14:00 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:00 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423" returned: 0 in 0.727s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:00 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423
Sep 23 00:14:00 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Flow 'volume_create_manager' (b098a069-7bf6-499b-b066-03c06a8dbce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a57e16-6983-49dd-907c-47d1461f1560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:01 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a57e16-6983-49dd-907c-47d1461f1560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1204591203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe50285-a45c-40ab-8a61-aec0bfc0e635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d2e6a3b2fb4d70887d78ed76073f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:01Z,use_quota=True,user_id='34d1315421714a6a8e93494cc21ad67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a325eca6-26ce-4c8d-a95d-d6738c26cb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a325eca6-26ce-4c8d-a95d-d6738c26cb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7bef23-0a0e-4404-84d3-7389415ec9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7bef23-0a0e-4404-84d3-7389415ec9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe50285-a45c-40ab-8a61-aec0bfc0e635', 'volume_name': 'volume-afe50285-a45c-40ab-8a61-aec0bfc0e635', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aae3ac-cc2f-40c2-b7fd-c3c2cd58982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aae3ac-cc2f-40c2-b7fd-c3c2cd58982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc25ff49-9940-4506-8721-01becec1a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Volume afe50285-a45c-40ab-8a61-aec0bfc0e635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe50285-a45c-40ab-8a61-aec0bfc0e635', 'volume_size': 1}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1204591203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe50285-a45c-40ab-8a61-aec0bfc0e635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d2e6a3b2fb4d70887d78ed76073f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:01Z,use_quota=True,user_id='34d1315421714a6a8e93494cc21ad67f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Creating volume afe50285-a45c-40ab-8a61-aec0bfc0e635 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:01 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0efae6e-2c85-4bec-8c24-e83298bf9423" returned: 0 in 0.473s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "cinder-quobyte-d0efae6e-2c85-4bec-8c24-e83298bf9423" released by "delete_volume" :: held 1.294s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:01 devstack sudo[91572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 1073741824
Sep 23 00:14:01 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:01 devstack cinder-volume[86631]: WARNING cinder.quota [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1975396632 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1975396632, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:14:01 devstack cinder-volume[86631]: WARNING cinder.quota [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1975396632 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1975396632, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Created reservations ['c8660aae-2ac6-45cc-9e4e-d2c42c4ddf54', '1a7434e7-51e7-496d-9123-7dcaeb989e86', '090fd0cf-fc08-4891-9332-67e354774614', 'b2fe0cf1-9b9f-49ce-bb40-5dbb007154cc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:01 devstack sudo[91574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:14:01 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:02 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.360s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Deleted volume successfully.
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-09347604-f475-4a2f-8cb2-4d4d3701f3e4 tempest-VolumeTypesAccessTest-1519547530 None] Lock "cinder-d0efae6e-2c85-4bec-8c24-e83298bf9423-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:02 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 1073741824" returned: 0 in 0.771s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:02 devstack sudo[91581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635
Sep 23 00:14:02 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:02 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc25ff49-9940-4506-8721-01becec1a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe50285-a45c-40ab-8a61-aec0bfc0e635', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02a7324-720c-46b8-85e6-e7f5bc4931fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Volume volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 (afe50285-a45c-40ab-8a61-aec0bfc0e635): created successfully
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02a7324-720c-46b8-85e6-e7f5bc4931fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Flow 'volume_create_manager' (b098a069-7bf6-499b-b066-03c06a8dbce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c29631eb-3352-4f8d-be04-b241da7dd3f5 tempest-VolumesTransfersV355Test-1626781291 None] Created volume successfully.
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "cinder-afe50285-a45c-40ab-8a61-aec0bfc0e635-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-afe50285-a45c-40ab-8a61-aec0bfc0e635-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "cinder-quobyte-afe50285-a45c-40ab-8a61-aec0bfc0e635" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-quobyte-afe50285-a45c-40ab-8a61-aec0bfc0e635" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa75341-8ecd-4978-ada1-c53417cb226d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:04 devstack sudo[91608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635
Sep 23 00:14:04 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:04 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635" returned: 0 in 0.507s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:04 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635
Sep 23 00:14:04 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:04 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-afe50285-a45c-40ab-8a61-aec0bfc0e635" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-quobyte-afe50285-a45c-40ab-8a61-aec0bfc0e635" released by "delete_volume" :: held 0.961s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:04 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Created reservations ['8da75457-6726-46e6-9a9b-0da01effaef3', '38fc078a-7d2c-46bd-961f-41a934e79256', '55c9049b-5235-403d-8ee8-f401b1b9aa3b', 'c08e335e-082c-4127-886c-bf4f933585e2'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:05 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:14:05 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:05 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.312s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Deleted volume successfully.
Sep 23 00:14:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77357562-9f74-470d-9afd-a0004e77be3b tempest-VolumesTransfersV355Test-1709566113 None] Lock "cinder-afe50285-a45c-40ab-8a61-aec0bfc0e635-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-193b04b0-1c8f-4c48-b7c3-00e6c88b4bc6 req-df735c7a-3c1e-41f8-a600-8f1c25fc9d9f tempest-ServerActionsTestOtherA-697217619 None] Terminate volume connection completed successfully.
Sep 23 00:14:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-193b04b0-1c8f-4c48-b7c3-00e6c88b4bc6 req-df735c7a-3c1e-41f8-a600-8f1c25fc9d9f tempest-ServerActionsTestOtherA-697217619 None] Deleting attachment 76160bef-4c2f-4d07-b998-b48547cc0568. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Flow 'volume_create_manager' (e47cefdf-abd7-48be-87e5-3a912eda2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ca7fb9-df19-4a0d-b8ba-3754bb182d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ca7fb9-df19-4a0d-b8ba-3754bb182d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1378176855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cda8dbb-8d54-4ae6-bbe2-00751502ed81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48162094c6434871a8e55a45e2660598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:23Z,use_quota=True,user_id='b62ffb19fc2d499993263f2be47fe12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256d4f0d-dae6-4685-88b1-cb9600db8c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256d4f0d-dae6-4685-88b1-cb9600db8c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96528fcc-ac0e-4f79-8d0f-fd3f39e14727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:22 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96528fcc-ac0e-4f79-8d0f-fd3f39e14727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cda8dbb-8d54-4ae6-bbe2-00751502ed81', 'volume_name': 'volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45a5640>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5618c747-f643-43d2-b8af-3edabc48b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5618c747-f643-43d2-b8af-3edabc48b515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de68172e-1345-4a66-9cd1-45fdf1ef2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:24 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45a5640>}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Trying to clone 1cda8dbb-8d54-4ae6-bbe2-00751502ed81 from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:14:24 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff40f8a-f016-4033-bbc7-e8b3927ebd66]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:24 devstack sudo[91794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD
Sep 23 00:14:24 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:25 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 is fetched for user b62ffb19fc2d499993263f2be47fe12d. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d440d-c602-4b91-b91a-9c9cecb3347d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:25 devstack sudo[91799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD
Sep 23 00:14:25 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Flow 'volume_create_manager' (bede0ea6-fee1-4c8b-a9ad-60287e4f65b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba70ad4-1117-44f4-a863-cd9b49876e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba70ad4-1117-44f4-a863-cd9b49876e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580922913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741c888c-36f5-4005-b7cc-81a0fa108719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e74b3ffa8e4fefabfcac9f1b4648ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:26Z,use_quota=True,user_id='1695210b0b144cb6b60a5dd4e8dc0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754a2522-709a-49c7-9cb9-588791977a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754a2522-709a-49c7-9cb9-588791977a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889aece3-c190-4582-8f1b-a5fe609df566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:14:25 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD" returned: 0 in 0.640s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1378176855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cda8dbb-8d54-4ae6-bbe2-00751502ed81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48162094c6434871a8e55a45e2660598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:23Z,use_quota=True,user_id='b62ffb19fc2d499993263f2be47fe12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Creating volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:25 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:14:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:25 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1073741824
Sep 23 00:14:25 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889aece3-c190-4582-8f1b-a5fe609df566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '741c888c-36f5-4005-b7cc-81a0fa108719', 'volume_name': 'volume-741c888c-36f5-4005-b7cc-81a0fa108719', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f4b6c290>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab22e8e-cec7-4d55-bb48-b7797852e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab22e8e-cec7-4d55-bb48-b7797852e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1eda27a-5541-4213-b012-6ccb9337b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:26 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Volume 741c888c-36f5-4005-b7cc-81a0fa108719: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-741c888c-36f5-4005-b7cc-81a0fa108719', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f4b6c290>}
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Trying to clone 741c888c-36f5-4005-b7cc-81a0fa108719 from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:14:26 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1073741824" returned: 0 in 0.887s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:26 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81
Sep 23 00:14:26 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:26 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:14:26 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f69fd-790c-4b61-b358-e5fcccf3bdfb]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:27 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD
Sep 23 00:14:27 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:27 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" returned: 0 in 0.440s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Attempting download of 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b2c5a-2c4b-40aa-bca7-cef54d2d6eb0]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:27 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 is fetched for user 1695210b0b144cb6b60a5dd4e8dc0976. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ebb476-521e-45dc-8f5b-88a01e62bccf]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:27 devstack sudo[91819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq
Sep 23 00:14:27 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:27 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD
Sep 23 00:14:27 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:28 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq" returned: 0 in 0.509s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:28 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580922913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741c888c-36f5-4005-b7cc-81a0fa108719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e74b3ffa8e4fefabfcac9f1b4648ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:26Z,use_quota=True,user_id='1695210b0b144cb6b60a5dd4e8dc0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Creating volume 741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:28 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:28 devstack sudo[91832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1073741824
Sep 23 00:14:28 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:28 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq
Sep 23 00:14:28 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:28 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq" returned: 1 in 0.525s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_35spxynq' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e83f8-a47f-4f95-80b1-9287ce1bbbf9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:28 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD
Sep 23 00:14:28 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:28 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1073741824" returned: 0 in 0.766s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:29 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719
Sep 23 00:14:29 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:29 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:29 devstack sudo[91866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81
Sep 23 00:14:29 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:29 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719" returned: 0 in 0.336s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Attempting download of 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 741c888c-36f5-4005-b7cc-81a0fa108719. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd580340-915c-4bb3-a9f0-0661fcc19dd6]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:29 devstack sudo[91872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj
Sep 23 00:14:29 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:29 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj" returned: 0 in 0.486s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:30 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj
Sep 23 00:14:30 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:30 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj" returned: 1 in 0.424s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_p_8qk4mj' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[40031226-7d9c-4a5f-abdc-d5b0fd48f213]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:30 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD
Sep 23 00:14:30 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:30 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:14:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:30 devstack sudo[91902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719
Sep 23 00:14:30 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:31 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" returned: 0 in 2.741s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:31 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_gfhvdeq2devstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:14:31 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Converted 112.00 MB image at 40.83 MB/s
Sep 23 00:14:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:31 devstack sudo[91932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1G
Sep 23 00:14:31 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:32 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 1G" returned: 0 in 0.495s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Downloaded image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 for user b62ffb19fc2d499993263f2be47fe12d is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Marking volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Copying metadata from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 to 1cda8dbb-8d54-4ae6-bbe2-00751502ed81. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Creating volume glance metadata for volume 1cda8dbb-8d54-4ae6-bbe2-00751502ed81 backed by image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de68172e-1345-4a66-9cd1-45fdf1ef2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45a5640>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788fefcd-26b7-465d-adf3-bf5c3d606b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Volume volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 (1cda8dbb-8d54-4ae6-bbe2-00751502ed81): created successfully
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788fefcd-26b7-465d-adf3-bf5c3d606b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Flow 'volume_create_manager' (e47cefdf-abd7-48be-87e5-3a912eda2b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-87df83e2-95f2-4f4c-afeb-c328c5ee0680 tempest-VolumesExtendTest-879660697 None] Created volume successfully.
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0877337-2a72-43fc-96d1-92cfd9778374]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:33 devstack sudo[91937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81
Sep 23 00:14:33 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:33 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719" returned: 0 in 2.723s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_sxcjwpsldevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:14:33 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Converted 112.00 MB image at 41.10 MB/s
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:33 devstack sudo[91939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1G
Sep 23 00:14:33 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:33 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 2G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 2G" returned: 0 in 0.133s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.769s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:33 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 1G" returned: 0 in 0.433s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Downloaded image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 741c888c-36f5-4005-b7cc-81a0fa108719 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 for user 1695210b0b144cb6b60a5dd4e8dc0976 is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Marking volume 741c888c-36f5-4005-b7cc-81a0fa108719 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Copying metadata from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 to 741c888c-36f5-4005-b7cc-81a0fa108719. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:14:33 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Creating volume glance metadata for volume 741c888c-36f5-4005-b7cc-81a0fa108719 backed by image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:14:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4a35a887-64d3-4ed4-8e30-3218f1109c52 tempest-VolumesExtendTest-879660697 None] Extend volume completed successfully.
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1eda27a-5541-4213-b012-6ccb9337b99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741c888c-36f5-4005-b7cc-81a0fa108719', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f4b6c290>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bce14c-7e14-4705-80b1-c38b9d75eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Volume volume-741c888c-36f5-4005-b7cc-81a0fa108719 (741c888c-36f5-4005-b7cc-81a0fa108719): created successfully
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bce14c-7e14-4705-80b1-c38b9d75eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Flow 'volume_create_manager' (bede0ea6-fee1-4c8b-a9ad-60287e4f65b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-758acc15-2223-4509-883c-5d2eea96c35b tempest-ServerActionsTestOtherA-697217619 None] Created volume successfully.
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-1cda8dbb-8d54-4ae6-bbe2-00751502ed81-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "cinder-1cda8dbb-8d54-4ae6-bbe2-00751502ed81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-quobyte-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:35 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16002bb-df30-46e5-837a-fc94eb57c36b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:35 devstack sudo[91953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81
Sep 23 00:14:35 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:35 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" returned: 0 in 0.593s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:35 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81
Sep 23 00:14:35 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:36 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" returned: 0 in 0.393s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-1cda8dbb-8d54-4ae6-bbe2-00751502ed81" released by "delete_volume" :: held 1.073s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Created reservations ['2a22aa8d-d428-4191-881f-9fb647243dd4', '4f96ea05-e6cb-4033-8a7b-da18a71e9fe7', 'f48b1f1e-29d4-4871-a3e8-ad1f11684599', 'fd119363-bdcf-4944-95b0-3d2116a28fad'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:36 devstack sudo[91965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:14:36 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:36 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.527s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:36 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Deleted volume successfully.
Sep 23 00:14:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1224dc4a-e2b3-4a1f-88db-dc009e9c6d6b tempest-VolumesExtendTest-879660697 None] Lock "cinder-1cda8dbb-8d54-4ae6-bbe2-00751502ed81-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Flow 'volume_create_manager' (d0b40fda-6478-475f-bc4c-ec6083b81f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a872c9-bb2c-4f9d-8d3f-eb414e3c818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a872c9-bb2c-4f9d-8d3f-eb414e3c818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-757877260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624bc632-5e2a-4c5d-9884-d5a7f1d11d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48162094c6434871a8e55a45e2660598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:38Z,use_quota=True,user_id='b62ffb19fc2d499993263f2be47fe12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b42f06-6d62-49d5-9b34-6bf8d45c1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b42f06-6d62-49d5-9b34-6bf8d45c1e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d1e7d8-4aee-4fdb-b4e4-f464c8e05045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d1e7d8-4aee-4fdb-b4e4-f464c8e05045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624bc632-5e2a-4c5d-9884-d5a7f1d11d08', 'volume_name': 'volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bc7cf6-e325-489e-a2ca-5a97dbfaa926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bc7cf6-e325-489e-a2ca-5a97dbfaa926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a996b-b4c2-46e0-b12d-cbad97cefbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Volume 624bc632-5e2a-4c5d-9884-d5a7f1d11d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08', 'volume_size': 1}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-757877260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624bc632-5e2a-4c5d-9884-d5a7f1d11d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48162094c6434871a8e55a45e2660598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:38Z,use_quota=True,user_id='b62ffb19fc2d499993263f2be47fe12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Creating volume 624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:38 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:14:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:38 devstack sudo[91977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 1073741824
Sep 23 00:14:38 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:39 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 1073741824" returned: 0 in 0.746s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:39 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:39 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c2ad3a7e-43e6-4a28-9538-8457ad5da138 req-bbff49d2-429a-43a1-89a7-a089b802ce08 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:39 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.441s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c2ad3a7e-43e6-4a28-9538-8457ad5da138 req-bbff49d2-429a-43a1-89a7-a089b802ce08 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.113s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a996b-b4c2-46e0-b12d-cbad97cefbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9674a-c222-43d6-b95e-d4ca95e19044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c2ad3a7e-43e6-4a28-9538-8457ad5da138 req-bbff49d2-429a-43a1-89a7-a089b802ce08 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Volume volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 (624bc632-5e2a-4c5d-9884-d5a7f1d11d08): created successfully
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9674a-c222-43d6-b95e-d4ca95e19044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Flow 'volume_create_manager' (d0b40fda-6478-475f-bc4c-ec6083b81f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0d84f309-848f-4dcb-87ba-6447ceafdbc9 tempest-VolumesExtendTest-879660697 None] Created volume successfully.
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-c2ad3a7e-43e6-4a28-9538-8457ad5da138 req-bbff49d2-429a-43a1-89a7-a089b802ce08 tempest-ServerActionsTestOtherA-697217619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-741c888c-36f5-4005-b7cc-81a0fa108719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adc42220-61bc-48de-9fa0-1520b4e4cfed', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:14:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c2ad3a7e-43e6-4a28-9538-8457ad5da138 req-bbff49d2-429a-43a1-89a7-a089b802ce08 tempest-ServerActionsTestOtherA-697217619 None] attachment_update completed successfully.
Sep 23 00:14:40 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (b5ca7f52-a25a-415d-96de-41426f50be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f4e7b5-f298-4fda-9fb0-f23974646c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f4e7b5-f298-4fda-9fb0-f23974646c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157916757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d40e924-a303-4363-ba0a-52f457359c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:41Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82328ae4-47f8-433b-8475-34334fde7b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82328ae4-47f8-433b-8475-34334fde7b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57334547-adca-4d3c-bd6d-122006f658b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57334547-adca-4d3c-bd6d-122006f658b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d40e924-a303-4363-ba0a-52f457359c7e', 'volume_name': 'volume-9d40e924-a303-4363-ba0a-52f457359c7e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ac49ee-7cde-4dc7-978c-767a8eb0a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ac49ee-7cde-4dc7-978c-767a8eb0a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53890583-9825-485b-9b40-3032362626a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Volume 9d40e924-a303-4363-ba0a-52f457359c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d40e924-a303-4363-ba0a-52f457359c7e', 'volume_size': 1}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157916757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d40e924-a303-4363-ba0a-52f457359c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:41Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Creating volume 9d40e924-a303-4363-ba0a-52f457359c7e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:14:41 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:41 devstack sudo[92000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e 1073741824
Sep 23 00:14:41 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:41 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e 1073741824" returned: 0 in 0.730s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:42 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e
Sep 23 00:14:42 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:42 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e" returned: 0 in 0.347s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53890583-9825-485b-9b40-3032362626a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d40e924-a303-4363-ba0a-52f457359c7e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ca8a64-39ed-45ed-961d-8e2d0a245565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Creating offline snapshot 600c253b-8f1d-4323-ace1-96117dbdc112 of volume 624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:14:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Volume volume-9d40e924-a303-4363-ba0a-52f457359c7e (9d40e924-a303-4363-ba0a-52f457359c7e): created successfully
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ca8a64-39ed-45ed-961d-8e2d0a245565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (b5ca7f52-a25a-415d-96de-41426f50be7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd12d0-70c7-4af5-8bc5-f7dd50a895ad]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-64650a62-5fdb-46b1-9161-879bbdd45a51 tempest-AttachVolumeTestJSON-929377795 None] Created volume successfully.
Sep 23 00:14:42 devstack sudo[92009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:42 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:43 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.548s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:43 devstack sudo[92016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 1G
Sep 23 00:14:43 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:43 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 1G" returned: 0 in 0.749s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:43 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112
Sep 23 00:14:43 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-4a8f9ef2-54bd-46e1-aac8-5e67b9458f02 req-cac62fb2-2f5f-48b5-ba7e-703b263f1c40 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:44 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112" returned: 0 in 0.517s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:44 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 is being set with open permissions: ugo+rw
Sep 23 00:14:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:44 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112
Sep 23 00:14:44 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:44 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112" returned: 0 in 0.456s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:44 devstack sudo[92149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info
Sep 23 00:14:44 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:45 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info" returned: 0 in 0.670s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:45 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info is being set with open permissions: ugo+rw
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:45 devstack sudo[92486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info
Sep 23 00:14:45 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:45 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.info" returned: 0 in 0.347s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.513s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-4a8f9ef2-54bd-46e1-aac8-5e67b9458f02 req-cac62fb2-2f5f-48b5-ba7e-703b263f1c40 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.698s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-4a8f9ef2-54bd-46e1-aac8-5e67b9458f02 req-cac62fb2-2f5f-48b5-ba7e-703b263f1c40 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f7541fb2-2caa-4624-b7f9-a91508585f9e tempest-VolumesExtendTest-879660697 None] Create snapshot completed successfully
Sep 23 00:14:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-4a8f9ef2-54bd-46e1-aac8-5e67b9458f02 req-cac62fb2-2f5f-48b5-ba7e-703b263f1c40 tempest-AttachVolumeTestJSON-929377795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-9d40e924-a303-4363-ba0a-52f457359c7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1475f3d-1746-4890-8002-5296c0160432', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:14:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-4a8f9ef2-54bd-46e1-aac8-5e67b9458f02 req-cac62fb2-2f5f-48b5-ba7e-703b263f1c40 tempest-AttachVolumeTestJSON-929377795 None] attachment_update completed successfully.
Sep 23 00:14:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80bbdb-99ca-4411-8482-59007170ae02]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:47 devstack sudo[92504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:47 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:47 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.845s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 2G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 2G" returned: 0 in 0.383s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.311s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4b089d75-304d-4653-bdab-7c123d681f34 tempest-VolumesExtendTest-879660697 None] Extend volume completed successfully.
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-600c253b-8f1d-4323-ace1-96117dbdc112-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-600c253b-8f1d-4323-ace1-96117dbdc112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-quobyte-600c253b-8f1d-4323-ace1-96117dbdc112" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-600c253b-8f1d-4323-ace1-96117dbdc112" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Deleting offline snapshot 600c253b-8f1d-4323-ace1-96117dbdc112 of volume 624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] snapshot_file for this snap is: volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50bf15-c2e2-4a43-82bb-e1f7ac305b78]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:49 devstack sudo[92526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112
Sep 23 00:14:49 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:50 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112" returned: 0 in 0.622s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:14:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc85856-30ec-482d-9741-9f04c7c3d847]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:50 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:50 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:51 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.759s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:51 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112
Sep 23 00:14:51 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112" returned: 0 in 0.612s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:51 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:51 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112
Sep 23 00:14:51 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:52 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08.600c253b-8f1d-4323-ace1-96117dbdc112" returned: 0 in 0.833s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=63,cinder:SELECT=66,cinder:DELETE=3,cinder:INSERT=30 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=76,cinder:UPDATE=68,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-600c253b-8f1d-4323-ace1-96117dbdc112" released by "_delete_snapshot" :: held 3.104s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" released by "delete_snapshot" :: held 3.175s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:52 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Created reservations ['21af7e64-4663-4814-a3e6-44d0d238f9a8', '4ee483f1-0b2f-4bb9-8bb8-27a2bac06712', 'eff8079d-a6dc-4254-9b94-3d918683e5cb', 'f4b19157-e9df-40d9-a4ef-c2f71c764172'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:14:53 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Delete snapshot completed successfully.
Sep 23 00:14:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496a059e-0925-4e21-8ae3-f17e261a23fe tempest-VolumesExtendTest-879660697 None] Lock "cinder-600c253b-8f1d-4323-ace1-96117dbdc112-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-624bc632-5e2a-4c5d-9884-d5a7f1d11d08-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "cinder-624bc632-5e2a-4c5d-9884-d5a7f1d11d08-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Acquiring lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c463f4-d8f3-4dab-ae96-2b509796fcf6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:14:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:54 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:54 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:55 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.672s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:55 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08
Sep 23 00:14:55 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:55 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" returned: 0 in 0.556s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "cinder-quobyte-624bc632-5e2a-4c5d-9884-d5a7f1d11d08" released by "delete_volume" :: held 1.379s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Created reservations ['09dda5b1-26a2-4dad-ad6b-54ee51f7f739', '293b9842-8995-4615-af50-ad0ca76d6811', '05ff7260-6f30-4eaa-8639-b17a4622ef31', 'e6224447-ad12-4621-b84b-ad134199aff4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:56 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:14:56 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:56 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.447s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Deleted volume successfully.
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8242f379-5d92-4582-92fd-da1d54805421 tempest-VolumesExtendTest-879660697 None] Lock "cinder-624bc632-5e2a-4c5d-9884-d5a7f1d11d08-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:14:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:14:56 devstack sudo[92566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:14:56 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:14:57 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root
Sep 23 00:14:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.815s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:14:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:14:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:14:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 28 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:14:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:15:05 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:06 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:15:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-46b50457-6257-4e46-aedb-11ab69de14e5 tempest-ServerActionsTestOtherA-697217619 None] Terminate volume connection completed successfully.
Sep 23 00:15:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-46b50457-6257-4e46-aedb-11ab69de14e5 tempest-ServerActionsTestOtherA-697217619 None] Deleting attachment adc42220-61bc-48de-9fa0-1520b4e4cfed. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:15:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-fc76c3d6-5188-46dc-b480-0c2a283c067a tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-fc76c3d6-5188-46dc-b480-0c2a283c067a tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-fc76c3d6-5188-46dc-b480-0c2a283c067a tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-fc76c3d6-5188-46dc-b480-0c2a283c067a tempest-ServerActionsTestOtherA-697217619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-741c888c-36f5-4005-b7cc-81a0fa108719', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc299abf-04c5-4f93-9e80-f0b953acb705', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:15:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-bb589b3c-32fb-47be-9ab4-b39c7063d8ee req-fc76c3d6-5188-46dc-b480-0c2a283c067a tempest-ServerActionsTestOtherA-697217619 None] attachment_update completed successfully.
Sep 23 00:15:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (1b3520ad-21aa-4989-8dad-7593f38c76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cae23d0-1816-485f-98d7-446c68ad62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cae23d0-1816-485f-98d7-446c68ad62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-78902400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e6f93-6316-4568-9171-96b26ffdcb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de96cbf-00fe-493c-8fb5-7c019c9887a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de96cbf-00fe-493c-8fb5-7c019c9887a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970062b1-8a0a-421a-91e4-b872eada5c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970062b1-8a0a-421a-91e4-b872eada5c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90e6f93-6316-4568-9171-96b26ffdcb18', 'volume_name': 'volume-d90e6f93-6316-4568-9171-96b26ffdcb18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081b077d-6822-4058-920d-07d0ee6b5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081b077d-6822-4058-920d-07d0ee6b5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1405d0-cc00-4a0c-8f14-27d93217c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Volume d90e6f93-6316-4568-9171-96b26ffdcb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90e6f93-6316-4568-9171-96b26ffdcb18', 'volume_size': 1}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-78902400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e6f93-6316-4568-9171-96b26ffdcb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Creating volume d90e6f93-6316-4568-9171-96b26ffdcb18 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:25 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:15:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:25 devstack sudo[92910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 1073741824
Sep 23 00:15:25 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:26 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 1073741824" returned: 0 in 1.073s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:26 devstack sudo[92917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18
Sep 23 00:15:26 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:26 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18" returned: 0 in 0.610s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1405d0-cc00-4a0c-8f14-27d93217c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90e6f93-6316-4568-9171-96b26ffdcb18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0dd096-2a6a-4960-aebc-993297548b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:27 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Volume volume-d90e6f93-6316-4568-9171-96b26ffdcb18 (d90e6f93-6316-4568-9171-96b26ffdcb18): created successfully
Sep 23 00:15:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0dd096-2a6a-4960-aebc-993297548b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (1b3520ad-21aa-4989-8dad-7593f38c76fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6c0a2da1-dd39-46e5-82d9-5ea89d56806b tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:15:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea09f1a9-0883-4058-b06c-47a6d1fc98f6 tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18" by "attach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea09f1a9-0883-4058-b06c-47a6d1fc98f6 tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18" acquired by "attach_volume" :: waited 0.079s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ea09f1a9-0883-4058-b06c-47a6d1fc98f6 tempest-VolumesActionsTest-611493156 None] Attaching volume d90e6f93-6316-4568-9171-96b26ffdcb18 to instance 2dd02ccf-20fc-4f95-b845-097baa2512d8 at mountpoint /dev/vdb on host None.
Sep 23 00:15:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ea09f1a9-0883-4058-b06c-47a6d1fc98f6 tempest-VolumesActionsTest-611493156 None] Attach volume completed successfully.
Sep 23 00:15:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea09f1a9-0883-4058-b06c-47a6d1fc98f6 tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18" released by "attach_volume" :: held 0.258s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Terminate volume connection completed successfully.
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" by "detach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Detaching volume d90e6f93-6316-4568-9171-96b26ffdcb18 from instance 2dd02ccf-20fc-4f95-b845-097baa2512d8.
Sep 23 00:15:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Detach volume completed successfully.
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1f1a0a7-fd86-44e7-9117-e18b06ffe0b3 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b344a4fc-0830-412b-b1f2-ad57150e29ad tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" by "detach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b344a4fc-0830-412b-b1f2-ad57150e29ad tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b344a4fc-0830-412b-b1f2-ad57150e29ad tempest-VolumesActionsTest-611493156 None] Volume detach called, but volume not attached.
Sep 23 00:15:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b344a4fc-0830-412b-b1f2-ad57150e29ad tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-quobyte-d90e6f93-6316-4568-9171-96b26ffdcb18" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "cinder-quobyte-d90e6f93-6316-4568-9171-96b26ffdcb18" acquired by "delete_volume" :: waited 0.058s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c4a63f-ccb6-4f39-a37a-fb8fcce1de18]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:15:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:32 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18
Sep 23 00:15:32 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:32 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18" returned: 0 in 0.940s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:32 devstack sudo[92964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18
Sep 23 00:15:32 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:33 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d90e6f93-6316-4568-9171-96b26ffdcb18" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "cinder-quobyte-d90e6f93-6316-4568-9171-96b26ffdcb18" released by "delete_volume" :: held 1.564s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Created reservations ['233d29fb-06cd-411c-9547-0cf97d07a195', '77ff512e-7284-4542-9b23-327673a02548', 'ab9340c7-5def-4a73-ad92-96ef80ac61a9', '311d9915-3254-4730-a019-d467faef61a8'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:33 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:15:33 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:33 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.464s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Deleted volume successfully.
Sep 23 00:15:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4be8f827-9f20-4e31-9386-6ac851a14e38 tempest-VolumesActionsTest-611493156 None] Lock "cinder-d90e6f93-6316-4568-9171-96b26ffdcb18-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (29289aa8-c541-4cad-b1ac-82702cdc3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb08a97-3326-4e49-ba4e-368a9c18b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb08a97-3326-4e49-ba4e-368a9c18b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1386079399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecfd273-0e38-4891-a0da-93cbb5e89f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5a72e-a860-4e53-9b31-db6c2618d82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5a72e-a860-4e53-9b31-db6c2618d82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddd6b6b-cb3c-4acd-8eb3-e59bf8fc3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddd6b6b-cb3c-4acd-8eb3-e59bf8fc3159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecfd273-0e38-4891-a0da-93cbb5e89f9b', 'volume_name': 'volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2424eb-5007-4f55-87e6-0637ee041c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2424eb-5007-4f55-87e6-0637ee041c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a9669-a7ce-4b9e-9aa6-2bb7f5fd9361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Volume 1ecfd273-0e38-4891-a0da-93cbb5e89f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b', 'volume_size': 1}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1386079399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecfd273-0e38-4891-a0da-93cbb5e89f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:38Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Creating volume 1ecfd273-0e38-4891-a0da-93cbb5e89f9b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:38 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:15:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:38 devstack sudo[93000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b 1073741824
Sep 23 00:15:38 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:39 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b 1073741824" returned: 0 in 0.838s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:39 devstack sudo[93006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b
Sep 23 00:15:39 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:39 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a9669-a7ce-4b9e-9aa6-2bb7f5fd9361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3436259e-8704-4410-add0-adc47e2058d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:39 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Volume volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b (1ecfd273-0e38-4891-a0da-93cbb5e89f9b): created successfully
Sep 23 00:15:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3436259e-8704-4410-add0-adc47e2058d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (29289aa8-c541-4cad-b1ac-82702cdc3295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4ddf3a16-0ae9-4134-9c2d-70e6fdffab24 tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-1ecfd273-0e38-4891-a0da-93cbb5e89f9b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-1ecfd273-0e38-4891-a0da-93cbb5e89f9b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-quobyte-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09543a5-3e2f-4d41-8299-a1a2777821b1]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:15:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:41 devstack sudo[93009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b
Sep 23 00:15:41 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:41 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" returned: 0 in 0.494s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:41 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b
Sep 23 00:15:41 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:41 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-1ecfd273-0e38-4891-a0da-93cbb5e89f9b" released by "delete_volume" :: held 0.867s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:41 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Created reservations ['d5ec1f8e-1daa-4919-be2f-ad92bfb16947', 'ce0dc6ca-0478-410c-a205-6140e230d5e2', '32de5c02-9c23-4330-9758-f390c8e8e0e3', '8e0460aa-3b52-4b69-9ccc-c7be9724ecde'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:42 devstack sudo[93017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:15:42 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:42 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Deleted volume successfully.
Sep 23 00:15:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-01e15223-f120-443b-bec8-8194fc9e14a5 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-1ecfd273-0e38-4891-a0da-93cbb5e89f9b-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (5d0fa42c-b6d5-4f98-94e3-5f7dd7cc90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638fbc2b-7d4c-410b-b57b-d62f585447f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638fbc2b-7d4c-410b-b57b-d62f585447f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1854495237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cae6444-efbe-4943-a2bd-b1633fc6da3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:44Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86b7c7c-d56a-423d-93f2-d6e4e6c36a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86b7c7c-d56a-423d-93f2-d6e4e6c36a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ff854e-7ae2-462c-a376-d4b288d3e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ff854e-7ae2-462c-a376-d4b288d3e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cae6444-efbe-4943-a2bd-b1633fc6da3c', 'volume_name': 'volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb012cd5-8108-4000-834a-fcc2453d1b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb012cd5-8108-4000-834a-fcc2453d1b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c12d36-096a-4d60-bb01-953124b34860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Volume 5cae6444-efbe-4943-a2bd-b1633fc6da3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c', 'volume_size': 1}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1854495237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cae6444-efbe-4943-a2bd-b1633fc6da3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:44Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Creating volume 5cae6444-efbe-4943-a2bd-b1633fc6da3c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-3bc84c19-3083-43f7-a0c1-daca981957e2 req-0d73e719-9fc9-42ac-a8e3-33687b37185b tempest-AttachVolumeTestJSON-929377795 None] Terminate volume connection completed successfully.
Sep 23 00:15:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-3bc84c19-3083-43f7-a0c1-daca981957e2 req-0d73e719-9fc9-42ac-a8e3-33687b37185b tempest-AttachVolumeTestJSON-929377795 None] Deleting attachment b1475f3d-1746-4890-8002-5296c0160432. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:15:44 devstack sudo[93089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c 1073741824
Sep 23 00:15:44 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:45 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c 1073741824" returned: 0 in 0.892s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:45 devstack sudo[93097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c
Sep 23 00:15:45 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:45 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c12d36-096a-4d60-bb01-953124b34860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f14a06-6ffc-48c3-bc86-578245c715ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Volume volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c (5cae6444-efbe-4943-a2bd-b1633fc6da3c): created successfully
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f14a06-6ffc-48c3-bc86-578245c715ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (5d0fa42c-b6d5-4f98-94e3-5f7dd7cc90fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a9f5c87b-9f05-41d5-a5e9-1a8c8829c944 tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-5cae6444-efbe-4943-a2bd-b1633fc6da3c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-5cae6444-efbe-4943-a2bd-b1633fc6da3c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-quobyte-5cae6444-efbe-4943-a2bd-b1633fc6da3c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-5cae6444-efbe-4943-a2bd-b1633fc6da3c" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc3b600-c4b6-4e10-b9e0-185fe1f6c27f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:15:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:46 devstack sudo[93105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c
Sep 23 00:15:46 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:47 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c" returned: 0 in 0.473s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:47 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c
Sep 23 00:15:47 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:47 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5cae6444-efbe-4943-a2bd-b1633fc6da3c" returned: 0 in 0.359s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-5cae6444-efbe-4943-a2bd-b1633fc6da3c" released by "delete_volume" :: held 0.948s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Created reservations ['7e74c986-8eec-4e87-bfd6-234033f2efc0', 'bba2159f-7d93-4c5a-9c03-d5c5c1dd6906', '3f4568fb-9579-4490-ac3d-52ba13d0a06f', '6d5e690f-fa66-42d2-807b-80ac6153061e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:47 devstack sudo[93116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:15:47 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:48 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:48 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Deleted volume successfully.
Sep 23 00:15:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39fb0c9a-da17-41ef-bdbe-ea882f18d756 tempest-VolumesActionsTest-1526092189 None] Lock "cinder-5cae6444-efbe-4943-a2bd-b1633fc6da3c-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (dbc65baa-98c2-4c64-b8f7-eb4d143f8d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06013b4c-359a-47a8-bf36-e22b10361e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06013b4c-359a-47a8-bf36-e22b10361e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193191092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce83fb92-663a-43a0-a1df-3b9fcad11b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:50Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02fec5b-134d-42cc-9009-ca3427522fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02fec5b-134d-42cc-9009-ca3427522fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aedcf6-99d4-4860-9eb8-bc9a34bf5a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aedcf6-99d4-4860-9eb8-bc9a34bf5a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce83fb92-663a-43a0-a1df-3b9fcad11b7d', 'volume_name': 'volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889b76fc-b0f9-487f-b71b-cbf10af26df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889b76fc-b0f9-487f-b71b-cbf10af26df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37449341-da2e-4abc-b75d-c8bd82dd887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Volume ce83fb92-663a-43a0-a1df-3b9fcad11b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d', 'volume_size': 1}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1193191092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce83fb92-663a-43a0-a1df-3b9fcad11b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:50Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Creating volume ce83fb92-663a-43a0-a1df-3b9fcad11b7d {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:50 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:15:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:50 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d 1073741824
Sep 23 00:15:50 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:51 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d 1073741824" returned: 0 in 1.049s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:51 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d
Sep 23 00:15:51 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:51 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" returned: 0 in 0.489s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37449341-da2e-4abc-b75d-c8bd82dd887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd9297d-a34e-4103-b05e-9e5b186939b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:51 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Volume volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d (ce83fb92-663a-43a0-a1df-3b9fcad11b7d): created successfully
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd9297d-a34e-4103-b05e-9e5b186939b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (dbc65baa-98c2-4c64-b8f7-eb4d143f8d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-60f50c61-ccf0-4966-9082-b436995b8ee8 tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-ce83fb92-663a-43a0-a1df-3b9fcad11b7d-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "cinder-ce83fb92-663a-43a0-a1df-3b9fcad11b7d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-quobyte-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8484e35-9a7a-47df-b122-c34cc9f3f9e9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:15:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:53 devstack sudo[93227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d
Sep 23 00:15:53 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:54 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" returned: 0 in 0.918s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:54 devstack sudo[93234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d
Sep 23 00:15:54 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:55 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" returned: 0 in 0.521s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-ce83fb92-663a-43a0-a1df-3b9fcad11b7d" released by "delete_volume" :: held 1.513s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Created reservations ['487f383d-fe04-4ec4-93f7-f9f620f74623', '1e67d138-86ba-46f6-8b58-b2d52bad713e', 'f875ff9e-138b-44af-a585-f46d36856762', '6f30b836-f31e-43c1-a023-683e73a6eb50'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:55 devstack sudo[93238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:15:55 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:55 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.320s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Deleted volume successfully.
Sep 23 00:15:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ed9dc70-9cb8-4571-9818-1efe700485df tempest-VolumesActionsTest-1526092189 None] Lock "cinder-ce83fb92-663a-43a0-a1df-3b9fcad11b7d-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (1016bf9a-8f83-4389-8d19-ba43ba28ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8becc933-cede-4105-a352-b6e10a9ac5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8becc933-cede-4105-a352-b6e10a9ac5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-654543588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be4adbb-27ef-4554-b8b3-cc3f56d5397f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:57Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b1f7f-41db-49e7-9458-938849507034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b1f7f-41db-49e7-9458-938849507034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345d212-ebb3-4805-8265-0f6ca26db570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345d212-ebb3-4805-8265-0f6ca26db570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be4adbb-27ef-4554-b8b3-cc3f56d5397f', 'volume_name': 'volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33016e3-588e-4b17-b6d4-9223d20a3891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33016e3-588e-4b17-b6d4-9223d20a3891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd27cdf-2f59-47bc-bfc6-000658844bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:56 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Volume 8be4adbb-27ef-4554-b8b3-cc3f56d5397f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f', 'volume_size': 1}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-654543588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be4adbb-27ef-4554-b8b3-cc3f56d5397f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:57Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Creating volume 8be4adbb-27ef-4554-b8b3-cc3f56d5397f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:15:56 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:56 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f 1073741824
Sep 23 00:15:56 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:56 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:15:56 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:57 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.398s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 28 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:15:57 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f 1073741824" returned: 0 in 0.626s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:57 devstack sudo[93250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f
Sep 23 00:15:57 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:57 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" returned: 0 in 0.407s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd27cdf-2f59-47bc-bfc6-000658844bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689917c1-3028-40ee-ade5-1f4d879b657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:15:57 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Volume volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f (8be4adbb-27ef-4554-b8b3-cc3f56d5397f): created successfully
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689917c1-3028-40ee-ade5-1f4d879b657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:15:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (1016bf9a-8f83-4389-8d19-ba43ba28ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:15:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9bf5e051-f022-4cb1-84c4-c33118e92505 tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-8be4adbb-27ef-4554-b8b3-cc3f56d5397f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "cinder-8be4adbb-27ef-4554-b8b3-cc3f56d5397f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Acquiring lock "cinder-quobyte-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2104045-c352-4bb5-9f4b-d60440504a81]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:59 devstack sudo[93254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f
Sep 23 00:15:59 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:15:59 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" returned: 0 in 0.589s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:15:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:15:59 devstack sudo[93259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f
Sep 23 00:15:59 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:00 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" returned: 0 in 0.408s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "cinder-quobyte-8be4adbb-27ef-4554-b8b3-cc3f56d5397f" released by "delete_volume" :: held 1.131s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Created reservations ['5c21edb9-57ff-41d1-821c-5a71fc92852a', 'f74bbb15-fa9b-419e-abbc-03d48db339d8', '6de45b8c-635f-4daf-a9f0-97249990c439', 'd95e218f-715b-4c52-9dbd-75d07dff4e0b'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:00 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:00 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:00 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:00 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Deleted volume successfully.
Sep 23 00:16:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8d2b2fd-ea2e-4a1d-a6df-f70e81444ecc tempest-VolumesActionsTest-1526092189 None] Lock "cinder-8be4adbb-27ef-4554-b8b3-cc3f56d5397f-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (79b12dd8-a02e-4d7f-82f6-3c0c72617a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922566be-5489-4758-905a-458a0aeeb2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922566be-5489-4758-905a-458a0aeeb2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-292205885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fdd060-50d6-489a-998f-9424b376312b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:02Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896607e6-39a9-400d-a897-3d4cc7242962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896607e6-39a9-400d-a897-3d4cc7242962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5ebce8-c8b5-4bd3-ac00-3db64a5dc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5ebce8-c8b5-4bd3-ac00-3db64a5dc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fdd060-50d6-489a-998f-9424b376312b', 'volume_name': 'volume-f2fdd060-50d6-489a-998f-9424b376312b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d202a9b3-8b39-4207-9d01-db57cc4455c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d202a9b3-8b39-4207-9d01-db57cc4455c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f3880b-9ced-488a-b398-8d7381454023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Volume f2fdd060-50d6-489a-998f-9424b376312b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fdd060-50d6-489a-998f-9424b376312b', 'volume_size': 1}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-292205885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fdd060-50d6-489a-998f-9424b376312b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7264a69244843e4a29571d15b062528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:02Z,use_quota=True,user_id='164a48422065425eb47cfedb1e482b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Creating volume f2fdd060-50d6-489a-998f-9424b376312b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:02 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:16:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:02 devstack sudo[93265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b 1073741824
Sep 23 00:16:02 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:03 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b 1073741824" returned: 0 in 0.657s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:03 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b
Sep 23 00:16:03 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:03 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f3880b-9ced-488a-b398-8d7381454023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fdd060-50d6-489a-998f-9424b376312b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8bd23-923f-4be1-81c3-2a061735a8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:03 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Volume volume-f2fdd060-50d6-489a-998f-9424b376312b (f2fdd060-50d6-489a-998f-9424b376312b): created successfully
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8bd23-923f-4be1-81c3-2a061735a8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Flow 'volume_create_manager' (79b12dd8-a02e-4d7f-82f6-3c0c72617a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:03 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1dc80b30-b19b-4002-8560-9db3c56a0a4b tempest-VolumesActionsTest-611493156 None] Created volume successfully.
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-f2fdd060-50d6-489a-998f-9424b376312b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "cinder-f2fdd060-50d6-489a-998f-9424b376312b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Acquiring lock "cinder-quobyte-f2fdd060-50d6-489a-998f-9424b376312b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "cinder-quobyte-f2fdd060-50d6-489a-998f-9424b376312b" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdd51ac-d365-4517-b4ec-e06df28e9a98]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:05 devstack sudo[93277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b
Sep 23 00:16:05 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (f11a71bf-1e93-4bb9-a25b-781cef460e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e267469-bc15-4ac9-ab74-cb11614d5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e267469-bc15-4ac9-ab74-cb11614d5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-445324637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e89f7b7-00e8-4819-859e-0e2a98c9fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:06Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dc19007-8d8b-4d69-a526-479d90d47912),volume_type_id=5dc19007-8d8b-4d69-a526-479d90d47912)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e35be25-cb2f-415a-a420-f2c705e6a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e35be25-cb2f-415a-a420-f2c705e6a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a72fa0e-3cbf-445b-9eb9-2a186c239a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a72fa0e-3cbf-445b-9eb9-2a186c239a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e89f7b7-00e8-4819-859e-0e2a98c9fa18', 'volume_name': 'volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0884948e-8613-4668-bf9d-712168e8ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0884948e-8613-4668-bf9d-712168e8ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb49feb-3e08-43a2-9b85-a2978970f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume 5e89f7b7-00e8-4819-859e-0e2a98c9fa18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18', 'volume_size': 1}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-445324637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e89f7b7-00e8-4819-859e-0e2a98c9fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:06Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dc19007-8d8b-4d69-a526-479d90d47912),volume_type_id=5dc19007-8d8b-4d69-a526-479d90d47912)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Creating volume 5e89f7b7-00e8-4819-859e-0e2a98c9fa18 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:06 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 1073741824
Sep 23 00:16:06 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:06 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b" returned: 0 in 1.084s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:06 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b
Sep 23 00:16:06 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=57,cinder:UPDATE=65,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=55,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (18af1651-531c-4c3c-a78e-f09222186e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b32845-23de-40ee-9fee-2d014547fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b32845-23de-40ee-9fee-2d014547fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2101169509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029e2e68-16a4-457f-bcd5-91bc4a52e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:07Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de1677d-6b1a-48e2-abaa-4246e5f82de1),volume_type_id=6de1677d-6b1a-48e2-abaa-4246e5f82de1)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7f4f76-d328-43b4-801f-14377d52e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7f4f76-d328-43b4-801f-14377d52e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db10ff46-f982-4e67-a6eb-7b94c7455327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db10ff46-f982-4e67-a6eb-7b94c7455327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029e2e68-16a4-457f-bcd5-91bc4a52e6b4', 'volume_name': 'volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a41f863-899e-4338-9ca3-4888c664eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a41f863-899e-4338-9ca3-4888c664eadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5c8b44-91fc-46a9-b1dd-bbf21095847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Volume 029e2e68-16a4-457f-bcd5-91bc4a52e6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4', 'volume_size': 1}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 1073741824" returned: 0 in 1.030s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack sudo[93324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18
Sep 23 00:16:07 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f2fdd060-50d6-489a-998f-9424b376312b" returned: 0 in 0.525s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "cinder-quobyte-f2fdd060-50d6-489a-998f-9424b376312b" released by "delete_volume" :: held 1.688s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Created reservations ['5b0a999a-4091-4260-bc6e-d31da316459d', '67f8bed8-05e5-443f-9029-802380101d2e', '5cbdaf8a-1ce7-467d-b856-b328efbe53a5', 'f271f5eb-cea1-472d-9976-d6cd6af7c749'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" returned: 0 in 0.434s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2101169509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029e2e68-16a4-457f-bcd5-91bc4a52e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:07Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de1677d-6b1a-48e2-abaa-4246e5f82de1),volume_type_id=6de1677d-6b1a-48e2-abaa-4246e5f82de1)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Creating volume 029e2e68-16a4-457f-bcd5-91bc4a52e6b4 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:07 devstack sudo[93328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:07 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:07 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:07 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 1073741824
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb49feb-3e08-43a2-9b85-a2978970f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8005b62-ec6e-4720-b156-7898ccca9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 (5e89f7b7-00e8-4819-859e-0e2a98c9fa18): created successfully
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8005b62-ec6e-4720-b156-7898ccca9431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (f11a71bf-1e93-4bb9-a25b-781cef460e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-36eb6f48-b591-44ab-842b-c881918c6197 tempest-TestInstancesWithCinderVolumes-545629872 None] Created volume successfully.
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (1a1f7cd7-bdbb-4dff-a4b1-4117002c13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99fcc69-23c6-4e23-aaed-a42b6ca18e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99fcc69-23c6-4e23-aaed-a42b6ca18e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-28231387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7877a6c9-acfc-49eb-bafe-152ab52f05de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:08Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(916511e5-d298-4def-a400-17d87c192333),volume_type_id=916511e5-d298-4def-a400-17d87c192333)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:08 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a637d73b-c1a0-41ef-99f5-3dd2d97c9ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a637d73b-c1a0-41ef-99f5-3dd2d97c9ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af78534a-5ec8-4250-b757-67df9998e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.627s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Deleted volume successfully.
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f3b565-6330-4cba-a9b6-58d0041e723f tempest-VolumesActionsTest-611493156 None] Lock "cinder-f2fdd060-50d6-489a-998f-9424b376312b-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:08 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 1073741824" returned: 0 in 0.984s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af78534a-5ec8-4250-b757-67df9998e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7877a6c9-acfc-49eb-bafe-152ab52f05de', 'volume_name': 'volume-7877a6c9-acfc-49eb-bafe-152ab52f05de', 'volume_size': 1, 'image_id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1487542703', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30c87256cf7946de88cfed56f7dd4da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'created_at': datetime.datetime(2026, 9, 22, 22, 16, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 16, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f44d6f90>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53c6b36-e232-4257-9096-41e67dbe7ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53c6b36-e232-4257-9096-41e67dbe7ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18fe7a-2ed2-4349-b87c-65c4cae7b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume 7877a6c9-acfc-49eb-bafe-152ab52f05de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7877a6c9-acfc-49eb-bafe-152ab52f05de', 'volume_size': 1, 'image_id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1487542703', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30c87256cf7946de88cfed56f7dd4da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'created_at': datetime.datetime(2026, 9, 22, 22, 16, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 16, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f44d6f90>}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Trying to clone 7877a6c9-acfc-49eb-bafe-152ab52f05de from image ecb2abf5-6da7-496f-ad68-f40ee9e72026 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:16:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:08 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4
Sep 23 00:16:08 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:09 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" returned: 0 in 0.468s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5c8b44-91fc-46a9-b1dd-bbf21095847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fc9862-4989-4475-a563-3627f20e2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Volume volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 (029e2e68-16a4-457f-bcd5-91bc4a52e6b4): created successfully
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fc9862-4989-4475-a563-3627f20e2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (18af1651-531c-4c3c-a78e-f09222186e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5436874d-716d-4911-bb25-d36edc4704eb tempest-TestInstancesWithCinderVolumes-545629872 None] Created volume successfully.
Sep 23 00:16:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-044e294e-cefd-4fb8-9d1c-240b41d591df tempest-ServerActionsTestOtherA-697217619 None] Terminate volume connection completed successfully.
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-044e294e-cefd-4fb8-9d1c-240b41d591df tempest-ServerActionsTestOtherA-697217619 None] Deleting attachment bc299abf-04c5-4f93-9e80-f0b953acb705. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "cinder-741c888c-36f5-4005-b7cc-81a0fa108719-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-741c888c-36f5-4005-b7cc-81a0fa108719-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "cinder-quobyte-741c888c-36f5-4005-b7cc-81a0fa108719" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-quobyte-741c888c-36f5-4005-b7cc-81a0fa108719" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b6a53c-9f30-49f2-9435-8290689a4c2f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:10 devstack sudo[93344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719
Sep 23 00:16:10 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:10 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:10 devstack sudo[93350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719
Sep 23 00:16:10 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:10 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-741c888c-36f5-4005-b7cc-81a0fa108719" returned: 0 in 0.389s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-quobyte-741c888c-36f5-4005-b7cc-81a0fa108719" released by "delete_volume" :: held 0.933s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "cinder-56adc4a0-d443-4a34-9b4f-31724a05bef6-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.quota [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Created reservations ['4d6f3e21-5452-40f4-937e-8ef021258e3f', 'c6e86400-27e0-4fcf-9318-f8d58ee44d41', 'b58bf65c-85dd-458b-a218-b18b332860f7', '24b78c65-c66a-460c-841c-d775c1ae84c4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-56adc4a0-d443-4a34-9b4f-31724a05bef6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "cinder-quobyte-56adc4a0-d443-4a34-9b4f-31724a05bef6" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-quobyte-56adc4a0-d443-4a34-9b4f-31724a05bef6" acquired by "delete_volume" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e7b60-a9e8-4d41-830f-6fd496a68bd8]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:11 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:11 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:11 devstack sudo[93355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6
Sep 23 00:16:11 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:11 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG cinder.manager [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Deleted volume successfully.
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-c1e7bc9d-2b9a-4c1e-b60b-729f0d05df9c req-b8341cb3-8b97-4c87-8994-b4e7c702f1f4 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-741c888c-36f5-4005-b7cc-81a0fa108719-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:11 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:11 devstack sudo[93364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6
Sep 23 00:16:11 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:11 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56adc4a0-d443-4a34-9b4f-31724a05bef6" returned: 0 in 0.331s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-quobyte-56adc4a0-d443-4a34-9b4f-31724a05bef6" released by "delete_volume" :: held 0.937s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Created reservations ['24f871bb-d096-4c84-b65d-7fb07b0deef9', 'aa90dc23-c44b-4fdc-ad07-31cdc6acdad2', '1d7e33bf-ea24-4737-a0f6-af4fc1d460d5', '1a5692ad-c425-49d2-9366-422663467f8e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:12 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:12 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:12 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Deleted volume successfully.
Sep 23 00:16:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c6096807-2f63-470d-9606-ecb90a259f13 tempest-ServerActionsTestOtherA-697217619 None] Lock "cinder-56adc4a0-d443-4a34-9b4f-31724a05bef6-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:14 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD, size 20.69 MB, duration 6.02 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:16:14 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Image download 20.69 MB at 3.44 MB/s
Sep 23 00:16:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d5c502-16ed-4749-8e5e-d12f439f2c34]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:14 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD
Sep 23 00:16:14 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:15 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Temporary image ecb2abf5-6da7-496f-ad68-f40ee9e72026 is fetched for user f1497b87b04341f387606b8a57b4db9a. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a23533-97cd-4713-9965-372edf89af21]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:15 devstack sudo[93413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD
Sep 23 00:16:15 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:15 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-28231387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7877a6c9-acfc-49eb-bafe-152ab52f05de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c87256cf7946de88cfed56f7dd4da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:08Z,use_quota=True,user_id='f1497b87b04341f387606b8a57b4db9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(916511e5-d298-4def-a400-17d87c192333),volume_type_id=916511e5-d298-4def-a400-17d87c192333)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Creating volume 7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:15 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:16:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:15 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1073741824
Sep 23 00:16:15 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:16 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1073741824" returned: 0 in 0.658s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:16 devstack sudo[93428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de
Sep 23 00:16:16 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:17 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Attempting download of ecb2abf5-6da7-496f-ad68-f40ee9e72026 ((None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}])) to volume 7877a6c9-acfc-49eb-bafe-152ab52f05de. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d058057-77b2-4408-ac29-f611617b4007]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:17 devstack sudo[93446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5
Sep 23 00:16:17 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:17 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5" returned: 0 in 0.554s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:18 devstack sudo[93456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5
Sep 23 00:16:18 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:18 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5" returned: 1 in 0.552s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ecb2abf5-6da7-496f-ad68-f40ee9e72026_d2e6_in5' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:16:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5fe259-bf32-4215-bca1-4ef892dc7ef6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:18 devstack sudo[93461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD
Sep 23 00:16:18 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:19 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD" returned: 0 in 0.633s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:19 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] ecb2abf5-6da7-496f-ad68-f40ee9e72026 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:16:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:19 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de
Sep 23 00:16:19 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:21 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de" returned: 0 in 2.858s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:21 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ecb2abf5-6da7-496f-ad68-f40ee9e72026_v3zf4cqsdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:16:21 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Converted 112.00 MB image at 39.17 MB/s
Sep 23 00:16:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:22 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1G
Sep 23 00:16:22 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:22 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de 1G" returned: 0 in 0.514s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Downloaded image ecb2abf5-6da7-496f-ad68-f40ee9e72026 ((None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}])) to volume 7877a6c9-acfc-49eb-bafe-152ab52f05de successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Temporary image ecb2abf5-6da7-496f-ad68-f40ee9e72026 for user f1497b87b04341f387606b8a57b4db9a is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Marking volume 7877a6c9-acfc-49eb-bafe-152ab52f05de as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Copying metadata from image ecb2abf5-6da7-496f-ad68-f40ee9e72026 to 7877a6c9-acfc-49eb-bafe-152ab52f05de. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Creating volume glance metadata for volume 7877a6c9-acfc-49eb-bafe-152ab52f05de backed by image ecb2abf5-6da7-496f-ad68-f40ee9e72026 with: {'image_id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'image_name': 'tempest-scenario-img--1487542703', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18fe7a-2ed2-4349-b87c-65c4cae7b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7877a6c9-acfc-49eb-bafe-152ab52f05de', 'volume_size': 1, 'image_id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1487542703', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30c87256cf7946de88cfed56f7dd4da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ecb2abf5-6da7-496f-ad68-f40ee9e72026', 'created_at': datetime.datetime(2026, 9, 22, 22, 16, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 16, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ecb2abf5-6da7-496f-ad68-f40ee9e72026/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f44d6f90>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e5f77b-3077-449c-b2e0-78894c75079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:22 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Volume volume-7877a6c9-acfc-49eb-bafe-152ab52f05de (7877a6c9-acfc-49eb-bafe-152ab52f05de): created successfully
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e5f77b-3077-449c-b2e0-78894c75079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Flow 'volume_create_manager' (1a1f7cd7-bdbb-4dff-a4b1-4117002c13ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-62257108-58f3-4e24-883f-dda6bbcb8153 tempest-TestInstancesWithCinderVolumes-545629872 None] Created volume successfully.
Sep 23 00:16:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-62eb4a26-0694-4fce-8ef3-05f3855886ec req-709e1fe8-4709-4c6d-a655-8edc0a019a5d tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-62eb4a26-0694-4fce-8ef3-05f3855886ec req-709e1fe8-4709-4c6d-a655-8edc0a019a5d tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-62eb4a26-0694-4fce-8ef3-05f3855886ec req-709e1fe8-4709-4c6d-a655-8edc0a019a5d tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-62eb4a26-0694-4fce-8ef3-05f3855886ec req-709e1fe8-4709-4c6d-a655-8edc0a019a5d tempest-TestInstancesWithCinderVolumes-545629872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-7877a6c9-acfc-49eb-bafe-152ab52f05de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa0a567b-5131-46d2-876a-310486fc1d0f', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:16:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-62eb4a26-0694-4fce-8ef3-05f3855886ec req-709e1fe8-4709-4c6d-a655-8edc0a019a5d tempest-TestInstancesWithCinderVolumes-545629872 None] attachment_update completed successfully.
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Flow 'volume_create_manager' (c50e02d6-870e-42a7-9c87-6b496b511d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1f0b94-084c-4569-be24-4ffc3cfac9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1f0b94-084c-4569-be24-4ffc3cfac9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-104667083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18737573-5c64-4766-8907-8d356f00af06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ef0a98f15546829d9e69542ac114c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:39Z,use_quota=True,user_id='7e8b5ac644fb4ccf92f25683680afb02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c96836-8cd9-4655-bae1-0e67ac37e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c96836-8cd9-4655-bae1-0e67ac37e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c457dbe-1234-467b-8774-c67fa71d5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c457dbe-1234-467b-8774-c67fa71d5446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18737573-5c64-4766-8907-8d356f00af06', 'volume_name': 'volume-18737573-5c64-4766-8907-8d356f00af06', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949af2af-5ba6-4e77-9aae-9e302b803eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949af2af-5ba6-4e77-9aae-9e302b803eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ce6166-9d49-48aa-b06c-290cff44f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Volume 18737573-5c64-4766-8907-8d356f00af06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18737573-5c64-4766-8907-8d356f00af06', 'volume_size': 1}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-104667083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18737573-5c64-4766-8907-8d356f00af06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ef0a98f15546829d9e69542ac114c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:39Z,use_quota=True,user_id='7e8b5ac644fb4ccf92f25683680afb02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Creating volume 18737573-5c64-4766-8907-8d356f00af06 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:16:38 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:16:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:38 devstack sudo[94047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 1073741824
Sep 23 00:16:38 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:39 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 1073741824" returned: 0 in 0.587s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:39 devstack sudo[94053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06
Sep 23 00:16:39 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:40 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06" returned: 0 in 0.670s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ce6166-9d49-48aa-b06c-290cff44f583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18737573-5c64-4766-8907-8d356f00af06', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd20b50-a37e-4180-be8e-b2112f4ddf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:16:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Volume volume-18737573-5c64-4766-8907-8d356f00af06 (18737573-5c64-4766-8907-8d356f00af06): created successfully
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd20b50-a37e-4180-be8e-b2112f4ddf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:16:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Flow 'volume_create_manager' (c50e02d6-870e-42a7-9c87-6b496b511d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:16:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8f70efa2-2f4f-4a50-9258-468c56f68c58 tempest-VolumesMetadataTest-576926094 None] Created volume successfully.
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Acquiring lock "cinder-18737573-5c64-4766-8907-8d356f00af06-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "cinder-18737573-5c64-4766-8907-8d356f00af06-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Acquiring lock "cinder-quobyte-18737573-5c64-4766-8907-8d356f00af06" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "cinder-quobyte-18737573-5c64-4766-8907-8d356f00af06" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d50de1-dc3b-49c7-a469-ed9678c9c414]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:43 devstack sudo[94057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06
Sep 23 00:16:43 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:43 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06" returned: 0 in 0.585s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:43 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06
Sep 23 00:16:43 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:44 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-18737573-5c64-4766-8907-8d356f00af06" returned: 0 in 0.425s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "cinder-quobyte-18737573-5c64-4766-8907-8d356f00af06" released by "delete_volume" :: held 1.092s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Created reservations ['45eda9cc-0061-49df-83e1-f06328152386', '7b7a80b9-e9fd-4410-a7c6-3e504aead31e', '4a712a33-9a58-47d4-9b3b-e770bec641d1', '3e67b3ee-662e-4107-a233-1f1820d5f28b'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:44 devstack sudo[94065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:44 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:45 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.366s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:45 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Deleted volume successfully.
Sep 23 00:16:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1cd5be29-dfd7-423c-a7ca-d990abaf16f4 tempest-VolumesMetadataTest-576926094 None] Lock "cinder-18737573-5c64-4766-8907-8d356f00af06-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:16:54 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=39,cinder:UPDATE=49,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:55 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=42,cinder:SELECT=38,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:16:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:16:57 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:16:57 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:16:57 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:16:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.964s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:16:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:16:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:16:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 28 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:16:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Flow 'volume_create_manager' (ca587ed2-c532-4706-9fc7-792177f0311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40437199-5679-4723-b205-c7eabeb98443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40437199-5679-4723-b205-c7eabeb98443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-165647001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9558f2d4-b37b-4526-a244-3909b77a608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ab2133490140f18087c90930f4172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:03Z,use_quota=True,user_id='550958a4de1545bab694063249d6b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b2c133-6bc6-4392-b3e4-c93a9a19b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b2c133-6bc6-4392-b3e4-c93a9a19b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2bfde6-5f55-467e-91dc-ea0b40cab2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2bfde6-5f55-467e-91dc-ea0b40cab2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9558f2d4-b37b-4526-a244-3909b77a608d', 'volume_name': 'volume-9558f2d4-b37b-4526-a244-3909b77a608d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c535d9f-2ce8-4a99-802c-457b7914a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c535d9f-2ce8-4a99-802c-457b7914a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ecea73-777a-43c1-a903-dbbfc332bf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:03 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Volume 9558f2d4-b37b-4526-a244-3909b77a608d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9558f2d4-b37b-4526-a244-3909b77a608d', 'volume_size': 1}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-165647001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9558f2d4-b37b-4526-a244-3909b77a608d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ab2133490140f18087c90930f4172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:03Z,use_quota=True,user_id='550958a4de1545bab694063249d6b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Creating volume 9558f2d4-b37b-4526-a244-3909b77a608d {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:03 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:03 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d 1073741824
Sep 23 00:17:03 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:04 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d 1073741824" returned: 0 in 1.074s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:04 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d
Sep 23 00:17:04 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:04 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d" returned: 0 in 0.787s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ecea73-777a-43c1-a903-dbbfc332bf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9558f2d4-b37b-4526-a244-3909b77a608d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f1bee4-aaf0-464a-94bb-7de856a597e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Volume volume-9558f2d4-b37b-4526-a244-3909b77a608d (9558f2d4-b37b-4526-a244-3909b77a608d): created successfully
Sep 23 00:17:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f1bee4-aaf0-464a-94bb-7de856a597e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Flow 'volume_create_manager' (ca587ed2-c532-4706-9fc7-792177f0311e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6a7f43ae-6b8f-4191-896a-8350c9408147 tempest-VolumesTransfersTest-1567453679 None] Created volume successfully.
Sep 23 00:17:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8937d59c-a066-4429-9431-1ec7b06ef911 tempest-VolumesTransfersTest-1661733055 None] Transfer volume completed successfully.
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Acquiring lock "cinder-9558f2d4-b37b-4526-a244-3909b77a608d-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "cinder-9558f2d4-b37b-4526-a244-3909b77a608d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Acquiring lock "cinder-quobyte-9558f2d4-b37b-4526-a244-3909b77a608d" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "cinder-quobyte-9558f2d4-b37b-4526-a244-3909b77a608d" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c141bd-b9d2-4cd2-825d-b1746ee80f07]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:10 devstack sudo[94350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d
Sep 23 00:17:10 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:11 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d" returned: 0 in 0.595s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:11 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d
Sep 23 00:17:11 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:11 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9558f2d4-b37b-4526-a244-3909b77a608d" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "cinder-quobyte-9558f2d4-b37b-4526-a244-3909b77a608d" released by "delete_volume" :: held 1.060s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Created reservations ['c828a8f9-b4eb-4778-937d-28400abb1485', 'a5cc507a-71aa-42f1-8883-aebccc069f75', 'b06a83eb-13a1-4323-8ec1-944bb40d75fd', '0cfed5e4-ce9a-45df-b14c-9f64e4b0c9a4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:11 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:11 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:12 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.429s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:12 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Deleted volume successfully.
Sep 23 00:17:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cd5bfcee-c5c6-4cba-a807-e2c22142532a tempest-VolumesTransfersTest-876722034 None] Lock "cinder-9558f2d4-b37b-4526-a244-3909b77a608d-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:14 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Flow 'volume_create_manager' (8bfbca18-1c23-41ca-b859-6a09f62c7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a91b72-1946-43d5-a203-5786a49b9a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a91b72-1946-43d5-a203-5786a49b9a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1245564024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a25908-c986-41f3-a579-7c85896c2690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ab2133490140f18087c90930f4172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:15Z,use_quota=True,user_id='550958a4de1545bab694063249d6b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fb6900-a5d4-406e-aa97-c70431a77c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fb6900-a5d4-406e-aa97-c70431a77c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377a4322-ed2c-442b-9be5-8b3218984a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377a4322-ed2c-442b-9be5-8b3218984a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a25908-c986-41f3-a579-7c85896c2690', 'volume_name': 'volume-f7a25908-c986-41f3-a579-7c85896c2690', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6798461a-04e3-44b0-bcc2-17d6ae4629d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6798461a-04e3-44b0-bcc2-17d6ae4629d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e8cb35-0099-41c0-a271-5e3ac303836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:15 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Volume f7a25908-c986-41f3-a579-7c85896c2690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a25908-c986-41f3-a579-7c85896c2690', 'volume_size': 1}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1245564024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a25908-c986-41f3-a579-7c85896c2690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ab2133490140f18087c90930f4172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:15Z,use_quota=True,user_id='550958a4de1545bab694063249d6b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Creating volume f7a25908-c986-41f3-a579-7c85896c2690 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:15 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:15 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 1073741824
Sep 23 00:17:15 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:16 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 1073741824" returned: 0 in 1.606s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1312c212-984e-430a-a380-0d1d8ad66889 req-a40a3ad9-bf94-41ed-8742-249231d832e9 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:17 devstack sudo[94457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690
Sep 23 00:17:17 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:17 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690" returned: 0 in 0.438s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] <== create_volume: return (2455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1312c212-984e-430a-a380-0d1d8ad66889 req-a40a3ad9-bf94-41ed-8742-249231d832e9 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.481s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-1312c212-984e-430a-a380-0d1d8ad66889 req-a40a3ad9-bf94-41ed-8742-249231d832e9 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e8cb35-0099-41c0-a271-5e3ac303836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a25908-c986-41f3-a579-7c85896c2690', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870f0a1f-6043-4a47-97e7-6bf1e410262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Volume volume-f7a25908-c986-41f3-a579-7c85896c2690 (f7a25908-c986-41f3-a579-7c85896c2690): created successfully
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870f0a1f-6043-4a47-97e7-6bf1e410262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Flow 'volume_create_manager' (8bfbca18-1c23-41ca-b859-6a09f62c7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1c50c853-d365-47fb-a5e3-95027a462124 tempest-VolumesTransfersTest-1567453679 None] Created volume successfully.
Sep 23 00:17:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-1312c212-984e-430a-a380-0d1d8ad66889 req-a40a3ad9-bf94-41ed-8742-249231d832e9 tempest-TestInstancesWithCinderVolumes-545629872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cc04254-79e5-4790-a9b9-7e884bae7056', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:17:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-1312c212-984e-430a-a380-0d1d8ad66889 req-a40a3ad9-bf94-41ed-8742-249231d832e9 tempest-TestInstancesWithCinderVolumes-545629872 None] attachment_update completed successfully.
Sep 23 00:17:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Acquiring lock "cinder-f7a25908-c986-41f3-a579-7c85896c2690-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "cinder-f7a25908-c986-41f3-a579-7c85896c2690-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Acquiring lock "cinder-quobyte-f7a25908-c986-41f3-a579-7c85896c2690" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "cinder-quobyte-f7a25908-c986-41f3-a579-7c85896c2690" acquired by "delete_volume" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c016dc34-10be-4d3d-a2d0-14e1ec6b07e3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:20 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690
Sep 23 00:17:20 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:21 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690" returned: 0 in 1.130s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:21 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690
Sep 23 00:17:21 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:21 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f7a25908-c986-41f3-a579-7c85896c2690" returned: 0 in 0.562s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "cinder-quobyte-f7a25908-c986-41f3-a579-7c85896c2690" released by "delete_volume" :: held 1.795s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:21 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Created reservations ['233eb05b-6318-4a99-a1a3-5c9478d5f773', 'a3536312-9304-4cde-b7f6-d8b16d58d8d1', 'cde1d054-a25f-4fa1-a659-26be83cb6e8d', '30954b53-412c-45be-a854-f519db238ce4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:22 devstack sudo[94515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:22 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-600a368d-9c17-4040-909c-44bab7da07d7 req-2ca96f00-af4a-4679-8200-5776132b78b0 tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-600a368d-9c17-4040-909c-44bab7da07d7 req-2ca96f00-af4a-4679-8200-5776132b78b0 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-600a368d-9c17-4040-909c-44bab7da07d7 req-2ca96f00-af4a-4679-8200-5776132b78b0 tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-600a368d-9c17-4040-909c-44bab7da07d7 req-2ca96f00-af4a-4679-8200-5776132b78b0 tempest-TestInstancesWithCinderVolumes-545629872 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcf1d0ae-b543-4cbb-8649-9230a15b78c4', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:17:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-600a368d-9c17-4040-909c-44bab7da07d7 req-2ca96f00-af4a-4679-8200-5776132b78b0 tempest-TestInstancesWithCinderVolumes-545629872 None] attachment_update completed successfully.
Sep 23 00:17:22 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.585s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Deleted volume successfully.
Sep 23 00:17:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ef305117-875b-4f6d-8aed-a421d6841cfc tempest-VolumesTransfersTest-876722034 None] Lock "cinder-f7a25908-c986-41f3-a579-7c85896c2690-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (aba02db3-98a8-434e-b03e-5e778807243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8597343-fd5a-4bdf-8b1c-f27cd88bcb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8597343-fd5a-4bdf-8b1c-f27cd88bcb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2047422956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a741c08-76a4-4d18-a609-fc1109760747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:23Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b18ab6-9806-4c23-a7be-49558b0de0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b18ab6-9806-4c23-a7be-49558b0de0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35a33b9-f0f3-498d-832b-b9ca8b097f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35a33b9-f0f3-498d-832b-b9ca8b097f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a741c08-76a4-4d18-a609-fc1109760747', 'volume_name': 'volume-0a741c08-76a4-4d18-a609-fc1109760747', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842e2f27-c4c7-4ef6-aba3-fdcc07b0aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842e2f27-c4c7-4ef6-aba3-fdcc07b0aece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bd151d-9fd4-4078-95fe-b3b3b6b5d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:23 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Volume 0a741c08-76a4-4d18-a609-fc1109760747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a741c08-76a4-4d18-a609-fc1109760747', 'volume_size': 1}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2047422956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a741c08-76a4-4d18-a609-fc1109760747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:23Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Creating volume 0a741c08-76a4-4d18-a609-fc1109760747 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:23 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:23 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 1073741824
Sep 23 00:17:23 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:24 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 1073741824" returned: 0 in 0.959s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:24 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747
Sep 23 00:17:24 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:25 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747" returned: 0 in 0.696s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bd151d-9fd4-4078-95fe-b3b3b6b5d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a741c08-76a4-4d18-a609-fc1109760747', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b5c21e-f2ba-40a9-9b27-83b69301b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Volume volume-0a741c08-76a4-4d18-a609-fc1109760747 (0a741c08-76a4-4d18-a609-fc1109760747): created successfully
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b5c21e-f2ba-40a9-9b27-83b69301b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (aba02db3-98a8-434e-b03e-5e778807243f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f8051d37-082a-498d-bc29-c09748bde8f3 tempest-AttachVolumeTestJSON-929377795 None] Created volume successfully.
Sep 23 00:17:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-75df4f8b-8e83-45e7-95b5-a0f6dc391293 req-e06e91a4-875b-4fe2-89b2-880d58bbf6bd tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-75df4f8b-8e83-45e7-95b5-a0f6dc391293 req-e06e91a4-875b-4fe2-89b2-880d58bbf6bd tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-75df4f8b-8e83-45e7-95b5-a0f6dc391293 req-e06e91a4-875b-4fe2-89b2-880d58bbf6bd tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-75df4f8b-8e83-45e7-95b5-a0f6dc391293 req-e06e91a4-875b-4fe2-89b2-880d58bbf6bd tempest-AttachVolumeTestJSON-929377795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-0a741c08-76a4-4d18-a609-fc1109760747', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9c89c50-277e-4447-8214-73a63253458b', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:17:28 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Flow 'volume_create_manager' (12b9d3e0-1169-4a74-9d17-f3f24e377eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ffd954-f1b7-40fd-a52a-a2ccd62a14b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ffd954-f1b7-40fd-a52a-a2ccd62a14b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1485316407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51273a02-ad68-4387-9848-68546575db97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ab511bb0f3461a8c3d1d2279479cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:29Z,use_quota=True,user_id='4812b444b517433383f874160deb44a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7d5237-6b96-4eb8-9eb0-a4332f670879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7d5237-6b96-4eb8-9eb0-a4332f670879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef406ce0-fb61-4bc5-ad42-04d234c0ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef406ce0-fb61-4bc5-ad42-04d234c0ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51273a02-ad68-4387-9848-68546575db97', 'volume_name': 'volume-51273a02-ad68-4387-9848-68546575db97', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abf066f-688c-49d6-a7fb-68a771d23fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abf066f-688c-49d6-a7fb-68a771d23fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ae5bd-dbf8-448b-bade-85293e7c16ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:29 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Volume 51273a02-ad68-4387-9848-68546575db97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51273a02-ad68-4387-9848-68546575db97', 'volume_size': 1}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1485316407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51273a02-ad68-4387-9848-68546575db97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ab511bb0f3461a8c3d1d2279479cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:29Z,use_quota=True,user_id='4812b444b517433383f874160deb44a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Creating volume 51273a02-ad68-4387-9848-68546575db97 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:29 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:29 devstack sudo[94589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 1073741824
Sep 23 00:17:29 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-75df4f8b-8e83-45e7-95b5-a0f6dc391293 req-e06e91a4-875b-4fe2-89b2-880d58bbf6bd tempest-AttachVolumeTestJSON-929377795 None] attachment_update completed successfully.
Sep 23 00:17:30 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 1073741824" returned: 0 in 1.182s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:30 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97
Sep 23 00:17:30 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:30 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97" returned: 0 in 0.386s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ae5bd-dbf8-448b-bade-85293e7c16ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51273a02-ad68-4387-9848-68546575db97', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58721dc5-b3ba-4d05-a1d8-afaf6e3eab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Volume volume-51273a02-ad68-4387-9848-68546575db97 (51273a02-ad68-4387-9848-68546575db97): created successfully
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58721dc5-b3ba-4d05-a1d8-afaf6e3eab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Flow 'volume_create_manager' (12b9d3e0-1169-4a74-9d17-f3f24e377eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5c485e4c-1294-4b51-b119-f572937d61d9 tempest-ServerRescueNegativeTestJSON-125578321 None] Created volume successfully.
Sep 23 00:17:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c0f7b74a-c214-4a3d-8bed-884c7c4694fc req-506ba957-2204-4139-870a-3e4c609759f9 tempest-TestInstancesWithCinderVolumes-545629872 None] Terminate volume connection completed successfully.
Sep 23 00:17:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-c0f7b74a-c214-4a3d-8bed-884c7c4694fc req-506ba957-2204-4139-870a-3e4c609759f9 tempest-TestInstancesWithCinderVolumes-545629872 None] Deleting attachment 1cc04254-79e5-4790-a9b9-7e884bae7056. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-5e89f7b7-00e8-4819-859e-0e2a98c9fa18-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-5e89f7b7-00e8-4819-859e-0e2a98c9fa18-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (f914b080-c2da-4384-8e62-5ff5c50563c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342e9141-a15f-4541-8904-488eab840a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342e9141-a15f-4541-8904-488eab840a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1452490284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a969a-d8da-4544-9b38-64fc1caadd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:33Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936c0777-2950-484a-83ed-87ab4c1b3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936c0777-2950-484a-83ed-87ab4c1b3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9d5763-9661-4221-9f85-908509425807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9d5763-9661-4221-9f85-908509425807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17a969a-d8da-4544-9b38-64fc1caadd47', 'volume_name': 'volume-e17a969a-d8da-4544-9b38-64fc1caadd47', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d42883f-2fb4-4401-8a97-89f6a7d94583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d42883f-2fb4-4401-8a97-89f6a7d94583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06f670-e86d-4f66-b30f-0c352f27e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Volume e17a969a-d8da-4544-9b38-64fc1caadd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17a969a-d8da-4544-9b38-64fc1caadd47', 'volume_size': 1}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1452490284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a969a-d8da-4544-9b38-64fc1caadd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b48535552d471daf7be2bd18a7ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:33Z,use_quota=True,user_id='c6eea54b234948ca845c0b37ea8fd577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Creating volume e17a969a-d8da-4544-9b38-64fc1caadd47 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:33 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:33 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 1073741824
Sep 23 00:17:33 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-quobyte-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96485f-caaa-4fde-8690-ef699cde8551]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:33 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18
Sep 23 00:17:33 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:34 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" returned: 0 in 0.970s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:34 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18
Sep 23 00:17:34 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:34 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 1073741824" returned: 0 in 1.587s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:34 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" returned: 0 in 0.515s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-5e89f7b7-00e8-4819-859e-0e2a98c9fa18" released by "delete_volume" :: held 1.608s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:35 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47
Sep 23 00:17:35 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:35 devstack cinder-volume[86631]: WARNING cinder.quota [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894706121-378983343 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894706121-378983343, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:35 devstack cinder-volume[86631]: WARNING cinder.quota [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894706121-378983343 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894706121-378983343, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Created reservations ['3fd5577b-3e46-459f-be0a-e0a32ddad12d', 'e981b294-5001-42c9-bf44-cbb01c2f9a68', '5284aa21-e8bb-42e4-8b4c-4240ac45b7ab', '5069cdcc-0c4f-48d2-a7dd-fb586f25b62a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:35 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47" returned: 0 in 0.460s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06f670-e86d-4f66-b30f-0c352f27e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17a969a-d8da-4544-9b38-64fc1caadd47', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee5a8f5-df09-4e84-b751-14aee700a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Volume volume-e17a969a-d8da-4544-9b38-64fc1caadd47 (e17a969a-d8da-4544-9b38-64fc1caadd47): created successfully
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee5a8f5-df09-4e84-b751-14aee700a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Flow 'volume_create_manager' (f914b080-c2da-4384-8e62-5ff5c50563c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-21cf41de-c92b-4a90-ab45-509337c25e1d tempest-AttachVolumeTestJSON-929377795 None] Created volume successfully.
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:35 devstack sudo[94698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:35 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:36 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.506s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:36 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Deleted volume successfully.
Sep 23 00:17:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-558f2619-74b4-484a-ae2a-cf978c12350f tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-5e89f7b7-00e8-4819-859e-0e2a98c9fa18-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-83b6c19d-7f07-428f-a70e-5d917d827d39 req-75a53051-8fb8-4a54-ad3c-359bf94a45e5 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-83b6c19d-7f07-428f-a70e-5d917d827d39 req-75a53051-8fb8-4a54-ad3c-359bf94a45e5 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-83b6c19d-7f07-428f-a70e-5d917d827d39 req-75a53051-8fb8-4a54-ad3c-359bf94a45e5 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-83b6c19d-7f07-428f-a70e-5d917d827d39 req-75a53051-8fb8-4a54-ad3c-359bf94a45e5 tempest-AttachVolumeTestJSON-929377795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-e17a969a-d8da-4544-9b38-64fc1caadd47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd43e8be6-e1c3-4e32-9a69-c24d9c505ec9', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:17:38 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-83b6c19d-7f07-428f-a70e-5d917d827d39 req-75a53051-8fb8-4a54-ad3c-359bf94a45e5 tempest-AttachVolumeTestJSON-929377795 None] attachment_update completed successfully.
Sep 23 00:17:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-9afc7530-a221-4c25-b4cd-26c065be629d req-1935f737-808b-4780-abaf-ce2a0f958eed tempest-TestInstancesWithCinderVolumes-545629872 None] Terminate volume connection completed successfully.
Sep 23 00:17:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-9afc7530-a221-4c25-b4cd-26c065be629d req-1935f737-808b-4780-abaf-ce2a0f958eed tempest-TestInstancesWithCinderVolumes-545629872 None] Deleting attachment dcf1d0ae-b543-4cbb-8649-9230a15b78c4. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-029e2e68-16a4-457f-bcd5-91bc4a52e6b4-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-029e2e68-16a4-457f-bcd5-91bc4a52e6b4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-quobyte-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4251c204-fdb0-4988-b83f-40c7dad8d87e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:42 devstack sudo[94779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4
Sep 23 00:17:42 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-a2d50a51-cee3-4579-9d16-9f5599673d52 req-f98e2444-165f-4f0e-ad3b-4a610a824843 tempest-AttachVolumeTestJSON-929377795 None] Terminate volume connection completed successfully.
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-a2d50a51-cee3-4579-9d16-9f5599673d52 req-f98e2444-165f-4f0e-ad3b-4a610a824843 tempest-AttachVolumeTestJSON-929377795 None] Deleting attachment a9c89c50-277e-4447-8214-73a63253458b. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:42 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" returned: 0 in 0.854s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:43 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4
Sep 23 00:17:43 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:43 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" returned: 0 in 0.677s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-029e2e68-16a4-457f-bcd5-91bc4a52e6b4" released by "delete_volume" :: held 1.626s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:43 devstack cinder-volume[86631]: WARNING cinder.quota [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346697435-2022385726 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346697435-2022385726, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:43 devstack cinder-volume[86631]: WARNING cinder.quota [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346697435-2022385726 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346697435-2022385726, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Created reservations ['fe41017b-d1b3-4d18-b883-0ed1ba11aca3', 'c8807b79-a266-4db8-89b5-7c845a757e32', 'bba51d0d-7777-43da-ad3a-b187880363c5', 'c64abbe1-005f-4991-a6ee-427c5d5fd79e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:44 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:44 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Flow 'volume_create_manager' (7714887c-67e8-4138-ad10-f25ea7c6e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c5bea5-d7be-486a-bbef-430e405219df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c5bea5-d7be-486a-bbef-430e405219df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-113353257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08720995-1568-4957-82dd-b744c20e3061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf8dab7831e41a19756946765b77501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:45Z,use_quota=True,user_id='41516edc01824543aa5914ae1fafc8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba86f7b1-767a-4bb8-932c-7e763e703ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba86f7b1-767a-4bb8-932c-7e763e703ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff10a37-b05d-4f42-970a-f425ec5c22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff10a37-b05d-4f42-970a-f425ec5c22dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08720995-1568-4957-82dd-b744c20e3061', 'volume_name': 'volume-08720995-1568-4957-82dd-b744c20e3061', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2fbd3a-de04-4c30-9460-5800fb64c03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2fbd3a-de04-4c30-9460-5800fb64c03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77a3d7f-89d7-4895-aac9-819e4d6e06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Volume 08720995-1568-4957-82dd-b744c20e3061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08720995-1568-4957-82dd-b744c20e3061', 'volume_size': 1}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-113353257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08720995-1568-4957-82dd-b744c20e3061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf8dab7831e41a19756946765b77501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:45Z,use_quota=True,user_id='41516edc01824543aa5914ae1fafc8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Creating volume 08720995-1568-4957-82dd-b744c20e3061 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:44 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.676s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-1a38a193-7c4f-47e3-92ce-78f813210aff req-f1ed7a87-f325-4a57-93d4-a44b012e3b74 tempest-AttachVolumeTestJSON-929377795 None] Terminate volume connection completed successfully.
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-1a38a193-7c4f-47e3-92ce-78f813210aff req-f1ed7a87-f325-4a57-93d4-a44b012e3b74 tempest-AttachVolumeTestJSON-929377795 None] Deleting attachment d43e8be6-e1c3-4e32-9a69-c24d9c505ec9. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Deleted volume successfully.
Sep 23 00:17:44 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 1073741824
Sep 23 00:17:44 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f270ecdf-ea64-4148-98e1-5755ef31eefa tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-029e2e68-16a4-457f-bcd5-91bc4a52e6b4-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:46 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 1073741824" returned: 0 in 1.169s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:46 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061
Sep 23 00:17:46 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:46 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061" returned: 0 in 0.674s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77a3d7f-89d7-4895-aac9-819e4d6e06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08720995-1568-4957-82dd-b744c20e3061', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e392d5-12ef-42c1-9e2f-d0331dea7f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:46 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Volume volume-08720995-1568-4957-82dd-b744c20e3061 (08720995-1568-4957-82dd-b744c20e3061): created successfully
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e392d5-12ef-42c1-9e2f-d0331dea7f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Flow 'volume_create_manager' (7714887c-67e8-4138-ad10-f25ea7c6e490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:47 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-23d32694-8200-43a4-9ee1-923fc2634a62 tempest-VolumesTransfersV357Test-1484945953 None] Created volume successfully.
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Acquiring lock "cinder-51273a02-ad68-4387-9848-68546575db97-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "cinder-51273a02-ad68-4387-9848-68546575db97-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Acquiring lock "cinder-quobyte-51273a02-ad68-4387-9848-68546575db97" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "cinder-quobyte-51273a02-ad68-4387-9848-68546575db97" acquired by "delete_volume" :: waited 0.050s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b67dcc-23e5-43d8-8d1d-61337784a80a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:49 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97
Sep 23 00:17:49 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:50 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97" returned: 0 in 1.295s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:50 devstack sudo[94919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97
Sep 23 00:17:50 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-91bf1b52-6581-4ef8-a97e-30785e17542e tempest-VolumesTransfersV357Test-1926710487 None] Transfer volume completed successfully.
Sep 23 00:17:50 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-51273a02-ad68-4387-9848-68546575db97" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "cinder-quobyte-51273a02-ad68-4387-9848-68546575db97" released by "delete_volume" :: held 1.990s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Created reservations ['a8c0d57a-d7e7-4179-99c6-2a006b14c220', 'eeba23d5-0d5f-45c6-a55e-7b1e2742f418', '92752602-a013-4349-aabc-5d15563e5c1a', 'bf8128fa-5031-40f4-8381-858e508959bd'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:51 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:51 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:51 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.429s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Deleted volume successfully.
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-91c34fde-5868-4a23-92b8-290f2fec6cbb tempest-ServerRescueNegativeTestJSON-125578321 None] Lock "cinder-51273a02-ad68-4387-9848-68546575db97-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "cinder-08720995-1568-4957-82dd-b744c20e3061-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-08720995-1568-4957-82dd-b744c20e3061-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "cinder-quobyte-08720995-1568-4957-82dd-b744c20e3061" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-quobyte-08720995-1568-4957-82dd-b744c20e3061" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6ac78-18eb-4eef-9541-e4e0279f8b66]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:52 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061
Sep 23 00:17:52 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:52 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061" returned: 0 in 1.034s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:52 devstack sudo[94948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061
Sep 23 00:17:52 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:53 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-08720995-1568-4957-82dd-b744c20e3061" returned: 0 in 0.701s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-quobyte-08720995-1568-4957-82dd-b744c20e3061" released by "delete_volume" :: held 1.842s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:53 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-847e1f92-a801-4590-835d-e930dd7ae562 req-8fcb2f68-7502-4ad6-8983-286dc13a227b tempest-TestInstancesWithCinderVolumes-545629872 None] Terminate volume connection completed successfully.
Sep 23 00:17:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-847e1f92-a801-4590-835d-e930dd7ae562 req-8fcb2f68-7502-4ad6-8983-286dc13a227b tempest-TestInstancesWithCinderVolumes-545629872 None] Deleting attachment aa0a567b-5131-46d2-876a-310486fc1d0f. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:17:53 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Created reservations ['93d5642d-8dfb-471b-ad12-cca17d9157a4', '9c51298e-3c3b-428f-9803-d080271b6cb5', '59049bb8-a62d-434b-a1d1-0b5b7d728127', '45a3bb3a-2562-4b9d-a411-d1ae04050b35'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:54 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:54 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:54 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.919s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:55 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Deleted volume successfully.
Sep 23 00:17:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b9f71c28-0c60-4992-9e6d-a23a2c352cc6 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-08720995-1568-4957-82dd-b744c20e3061-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-7877a6c9-acfc-49eb-bafe-152ab52f05de-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=82,cinder:SELECT=69,cinder:DELETE=4,cinder:INSERT=16 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=81,cinder:INSERT=14,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-7877a6c9-acfc-49eb-bafe-152ab52f05de-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Flow 'volume_create_manager' (5400d9b8-467c-4963-adf2-d4980fba25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef57d628-698d-4b1a-a580-0e118389e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef57d628-698d-4b1a-a580-0e118389e446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-223391693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1845b9-b356-46ac-b883-7b3ac136b4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf8dab7831e41a19756946765b77501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:56Z,use_quota=True,user_id='41516edc01824543aa5914ae1fafc8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbda1e4c-8968-40af-9202-4183c5c8f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbda1e4c-8968-40af-9202-4183c5c8f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4d38bb-58b4-41a3-8de7-80bb7af42827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4d38bb-58b4-41a3-8de7-80bb7af42827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1845b9-b356-46ac-b883-7b3ac136b4b6', 'volume_name': 'volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9530a58-a80b-4c84-aa5d-c4565d567d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9530a58-a80b-4c84-aa5d-c4565d567d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c905e8ca-7bbe-442b-84c1-9776ec9c6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:56 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Volume fd1845b9-b356-46ac-b883-7b3ac136b4b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6', 'volume_size': 1}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-223391693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1845b9-b356-46ac-b883-7b3ac136b4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf8dab7831e41a19756946765b77501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:56Z,use_quota=True,user_id='41516edc01824543aa5914ae1fafc8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Creating volume fd1845b9-b356-46ac-b883-7b3ac136b4b6 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:17:56 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:56 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 1073741824
Sep 23 00:17:56 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "cinder-quobyte-7877a6c9-acfc-49eb-bafe-152ab52f05de" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-7877a6c9-acfc-49eb-bafe-152ab52f05de" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed21b23-a391-47f5-b8ce-38d5e702bc61]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:56 devstack sudo[94972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:56 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:57 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de
Sep 23 00:17:57 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:57 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.617s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:17:57 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 1073741824" returned: 0 in 1.162s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:57 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:57 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6
Sep 23 00:17:57 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de" returned: 0 in 1.080s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:57 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de
Sep 23 00:17:57 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:58 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6" returned: 0 in 0.537s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c905e8ca-7bbe-442b-84c1-9776ec9c6079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a7a2a8-dd91-46f3-b65b-852b72c1b3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:17:58 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Volume volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 (fd1845b9-b356-46ac-b883-7b3ac136b4b6): created successfully
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a7a2a8-dd91-46f3-b65b-852b72c1b3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:17:58 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Flow 'volume_create_manager' (5400d9b8-467c-4963-adf2-d4980fba25a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7877a6c9-acfc-49eb-bafe-152ab52f05de" returned: 0 in 0.556s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-quobyte-7877a6c9-acfc-49eb-bafe-152ab52f05de" released by "delete_volume" :: held 1.760s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:58 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-dc9075be-2fb3-4087-b6bd-7c3b22ed321d tempest-VolumesTransfersV357Test-1484945953 None] Created volume successfully.
Sep 23 00:17:58 devstack cinder-volume[86631]: WARNING cinder.quota [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784963535-1647005295 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784963535-1647005295, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:58 devstack cinder-volume[86631]: WARNING cinder.quota [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784963535-1647005295 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-784963535-1647005295, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Created reservations ['a54784eb-a4a7-463f-9114-48f21542e664', '6e299460-00c7-4d5f-b655-5fceb8f660c9', '1cb480b7-0350-4a57-b2ba-8ceed162f8e9', 'a6540431-b568-4ffd-b4e3-82d3328ffd77'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:17:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:58 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:17:58 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-e17a969a-d8da-4544-9b38-64fc1caadd47-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-e17a969a-d8da-4544-9b38-64fc1caadd47-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:59 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-quobyte-e17a969a-d8da-4544-9b38-64fc1caadd47" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.401s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:17:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Deleted volume successfully.
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-e17a969a-d8da-4544-9b38-64fc1caadd47" acquired by "delete_volume" :: waited 0.044s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77f4cf62-d426-40c5-8e16-eba9f25a924e tempest-TestInstancesWithCinderVolumes-545629872 None] Lock "cinder-7877a6c9-acfc-49eb-bafe-152ab52f05de-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c7b0f-9cc8-4a1b-88b6-c7a357cd4d9f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:59 devstack sudo[94992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47
Sep 23 00:17:59 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:17:59 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47" returned: 0 in 0.597s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:17:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:17:59 devstack sudo[95001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47
Sep 23 00:17:59 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "cinder-fd1845b9-b356-46ac-b883-7b3ac136b4b6-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-fd1845b9-b356-46ac-b883-7b3ac136b4b6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:00 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e17a969a-d8da-4544-9b38-64fc1caadd47" returned: 0 in 0.520s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "cinder-quobyte-fd1845b9-b356-46ac-b883-7b3ac136b4b6" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-e17a969a-d8da-4544-9b38-64fc1caadd47" released by "delete_volume" :: held 1.194s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-quobyte-fd1845b9-b356-46ac-b883-7b3ac136b4b6" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccaf8b7-d302-4ff4-b23a-7aedde46b430]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Created reservations ['de925ae3-26c3-4e04-9802-6a77328fa1d0', '6522ecd7-fa10-43cd-8e65-a44027f88546', '40416a64-b416-4c98-86af-9e12bab6da59', '2f6174f8-dc99-4b04-b865-ba2718a03d38'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:00 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6
Sep 23 00:18:00 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:00 devstack sudo[95024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:00 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:01 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.427s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Deleted volume successfully.
Sep 23 00:18:01 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6" returned: 0 in 0.695s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eabe2b62-cd41-4896-9b0d-3afbb305c911 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-e17a969a-d8da-4544-9b38-64fc1caadd47-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:01 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6
Sep 23 00:18:01 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-0a741c08-76a4-4d18-a609-fc1109760747-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:01 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-0a741c08-76a4-4d18-a609-fc1109760747-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fd1845b9-b356-46ac-b883-7b3ac136b4b6" returned: 0 in 0.548s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-quobyte-fd1845b9-b356-46ac-b883-7b3ac136b4b6" released by "delete_volume" :: held 1.341s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-quobyte-0a741c08-76a4-4d18-a609-fc1109760747" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-0a741c08-76a4-4d18-a609-fc1109760747" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be6a48c-97ed-401e-b6d1-4afe957e472e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:01 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Created reservations ['ae8b7b52-112b-4e31-a403-8b69e99b7606', '2b99d43d-61ab-451e-b69c-4be092c2c07b', '96255dd0-467a-4f29-a056-ca06e64d1783', '7f575c0a-5880-41bb-99ea-18ae69beba23'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:02 devstack sudo[95036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747
Sep 23 00:18:02 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:02 devstack sudo[95037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:02 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:02 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747" returned: 0 in 0.550s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:02 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.396s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Deleted volume successfully.
Sep 23 00:18:02 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747
Sep 23 00:18:02 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2000bcdf-a86e-4867-8ddf-2f6afeefcec7 tempest-VolumesTransfersV357Test-1728483332 None] Lock "cinder-fd1845b9-b356-46ac-b883-7b3ac136b4b6-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:02 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0a741c08-76a4-4d18-a609-fc1109760747" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-0a741c08-76a4-4d18-a609-fc1109760747" released by "delete_volume" :: held 0.926s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:02 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Created reservations ['d870d423-7cd5-49b1-8d72-5b8abb7df8a4', '58dcb856-ec65-4a14-ba6b-b413baca8f12', '59848dd3-11bf-4dac-b2be-aea30bfbd7a0', 'ff461795-cdc8-4760-90ad-6ecbcefe215c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:03 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:03 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:03 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:03 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Deleted volume successfully.
Sep 23 00:18:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5f591993-d993-4289-8139-76d1394f663a tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-0a741c08-76a4-4d18-a609-fc1109760747-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-9d40e924-a303-4363-ba0a-52f457359c7e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-9d40e924-a303-4363-ba0a-52f457359c7e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "cinder-quobyte-9d40e924-a303-4363-ba0a-52f457359c7e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-9d40e924-a303-4363-ba0a-52f457359c7e" acquired by "delete_volume" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6fa08d-3bec-4313-9753-7118b5f2bf6a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:04 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e
Sep 23 00:18:04 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:05 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e" returned: 0 in 0.539s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:05 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e
Sep 23 00:18:05 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:05 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d40e924-a303-4363-ba0a-52f457359c7e" returned: 0 in 0.320s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-quobyte-9d40e924-a303-4363-ba0a-52f457359c7e" released by "delete_volume" :: held 0.941s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Created reservations ['96a10e7e-2046-4b59-b1f7-35caca965ab7', '7064abda-c80a-4c9a-813a-9be4113a2e2b', '199967a9-528a-46b3-a9ca-72cd63edfdac', 'b163d222-2285-47ee-8d11-f072e3f4f432'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:05 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:05 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:05 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.326s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:05 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Deleted volume successfully.
Sep 23 00:18:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b61556a-fa08-4997-b6d9-1fad5dabe622 tempest-AttachVolumeTestJSON-929377795 None] Lock "cinder-9d40e924-a303-4363-ba0a-52f457359c7e-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:15 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=38,cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=11 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:15 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=30,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-69b051af-a290-4537-9382-73e8079ddf44 tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-577769721: creating
Sep 23 00:18:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-69b051af-a290-4537-9382-73e8079ddf44 tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-577769721: created successfully
Sep 23 00:18:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-69b051af-a290-4537-9382-73e8079ddf44 tempest-GroupSnapshotsTest-1512656541 None] Create group completed successfully.
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (def0f2bc-eafb-4ad6-8ab4-455738ff397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37bba73-5917-4c6b-be14-dbca433218e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37bba73-5917-4c6b-be14-dbca433218e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-205535411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f65defd-c90d-4172-8fdf-9c81c6ea023b,host='devstack@QuobyteHD#QuobyteHD',id=824043d8-a0c7-4024-9c7a-0ce1ab755fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:23Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84671af7-41db-4ff4-ad33-db54fd5ea2fd),volume_type_id=84671af7-41db-4ff4-ad33-db54fd5ea2fd)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be1bd1-cde7-4da7-8dda-8648c12ebba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be1bd1-cde7-4da7-8dda-8648c12ebba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52b89a-8823-474d-b9e6-70a1db47e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52b89a-8823-474d-b9e6-70a1db47e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824043d8-a0c7-4024-9c7a-0ce1ab755fd7', 'volume_name': 'volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d248ef-a368-429d-b891-a9a3286c74c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d248ef-a368-429d-b891-a9a3286c74c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca14e28-8f8f-4d0b-b8bd-d41fb8636687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:23 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Volume 824043d8-a0c7-4024-9c7a-0ce1ab755fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7', 'volume_size': 1}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8f65defd-c90d-4172-8fdf-9c81c6ea023b,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-205535411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f65defd-c90d-4172-8fdf-9c81c6ea023b,host='devstack@QuobyteHD#QuobyteHD',id=824043d8-a0c7-4024-9c7a-0ce1ab755fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:23Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84671af7-41db-4ff4-ad33-db54fd5ea2fd),volume_type_id=84671af7-41db-4ff4-ad33-db54fd5ea2fd)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Creating volume 824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:23 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:18:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:23 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 1073741824
Sep 23 00:18:23 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:24 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 1073741824" returned: 0 in 0.622s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:24 devstack sudo[95080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:24 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:24 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca14e28-8f8f-4d0b-b8bd-d41fb8636687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12761b2-2fc0-4a66-83a4-0793643faad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:24 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Volume volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 (824043d8-a0c7-4024-9c7a-0ce1ab755fd7): created successfully
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12761b2-2fc0-4a66-83a4-0793643faad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (def0f2bc-eafb-4ad6-8ab4-455738ff397b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0a19ab64-9957-4636-82e8-a7b9883a9384 tempest-GroupSnapshotsTest-1512656541 None] Created volume successfully.
Sep 23 00:18:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] GroupSnapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: creating.
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Group snapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: creating. {{(pid=86631) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Creating offline snapshot 3b833222-7ab2-4c3d-95f1-49892ba3268b of volume 824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b798b3-c017-4254-992d-086ec4221ae0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:26 devstack sudo[95083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:26 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:26 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 0.485s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:26 devstack sudo[95088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b 1G
Sep 23 00:18:26 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:27 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b 1G" returned: 0 in 0.485s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:27 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:27 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:27 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:27 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:27 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:27 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:27 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 0.382s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:27 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info
Sep 23 00:18:27 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:28 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info" returned: 0 in 0.345s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:28 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:18:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:28 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info
Sep 23 00:18:28 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:28 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.info" returned: 0 in 0.370s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5e8456c6-cce8-4926-a9b0-aa226ad06dee tempest-GroupSnapshotsTest-1512656541 None] group_snapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: created successfully
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b-7cad3650-4f94-4058-bdfa-bb9b6856b84c" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b-7cad3650-4f94-4058-bdfa-bb9b6856b84c" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Creating volume 7cad3650-4f94-4058-bdfa-bb9b6856b84c from snapshot 3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] snapshot: 3b833222-7ab2-4c3d-95f1-49892ba3268b, volume: 7cad3650-4f94-4058-bdfa-bb9b6856b84c,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14e994-40d8-47b9-8ab7-61d858db8dc6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:31 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:31 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:31 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 0.667s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafa77d-b0a5-4abe-938a-293ac3d396b6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:31 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:31 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:32 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 0.581s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:18:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:18:32 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:18:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:32 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c
Sep 23 00:18:32 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:18:44 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c" returned: 0 in 11.947s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7, size 1024.00 MB, duration 11.95 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:18:44 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Converted 1024.00 MB image at 85.70 MB/s
Sep 23 00:18:44 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:44 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c
Sep 23 00:18:44 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Flow 'volume_create_manager' (834e0e83-ce41-4160-bcbd-4778819af019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a387a0be-e689-45fd-bd15-a6f7adbaa2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a387a0be-e689-45fd-bd15-a6f7adbaa2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b192b2-9deb-4453-a229-446cfb8899e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0ffa7ae7524d26a7e95e093cc18ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:44Z,use_quota=True,user_id='398e2e9710164e8e80d203306b719e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c22595a-3ee1-4c00-be54-0bc01527582c),volume_type_id=8c22595a-3ee1-4c00-be54-0bc01527582c)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf323475-77d8-4ffe-a7c5-61b3aed5c04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf323475-77d8-4ffe-a7c5-61b3aed5c04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04f4747-699e-47ed-9966-4f315f42f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:18:44 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c" returned: 0 in 0.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" released by "_copy_volume_from_snapshot" :: held 14.047s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Flow 'volume_create_manager' (05d3fac3-795d-4157-bc58-2a830e4bb868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c246ec2e-4ec7-430a-8547-a626c88568ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c246ec2e-4ec7-430a-8547-a626c88568ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784830908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6a781-ed08-489b-a73a-583630d70192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf307c9bf5754488bd6caadf72d5fc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='e7e80f411f2b4b10aa34d5ca4099ddf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15821bff-3cbc-431f-8f2d-694a468471e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15821bff-3cbc-431f-8f2d-694a468471e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a48033-a9a9-4d8a-9fb9-9295b3e7d6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a48033-a9a9-4d8a-9fb9-9295b3e7d6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc6a781-ed08-489b-a73a-583630d70192', 'volume_name': 'volume-fbc6a781-ed08-489b-a73a-583630d70192', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27ebae-43dc-425a-8153-f8ab0d56a667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27ebae-43dc-425a-8153-f8ab0d56a667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328eff5c-f1e0-44a9-b6c6-7fa78003451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Volume fbc6a781-ed08-489b-a73a-583630d70192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc6a781-ed08-489b-a73a-583630d70192', 'volume_size': 1}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b-7cad3650-4f94-4058-bdfa-bb9b6856b84c" released by "_create_volume_from_snapshot" :: held 14.287s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.344s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784830908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6a781-ed08-489b-a73a-583630d70192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf307c9bf5754488bd6caadf72d5fc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='e7e80f411f2b4b10aa34d5ca4099ddf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Creating volume fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:18:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:44 devstack sudo[95214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 1073741824
Sep 23 00:18:44 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a70d7d41-b99f-426e-8e3b-f21c25aa9e11 tempest-GroupSnapshotsTest-1512656541 None] Create group from source-snapshot-ba0b1880-53e1-4b02-8b1e-1e23feb181a6 completed successfully.
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04f4747-699e-47ed-9966-4f315f42f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30b192b2-9deb-4453-a229-446cfb8899e4', 'volume_name': 'volume-30b192b2-9deb-4453-a229-446cfb8899e4', 'volume_size': 1, 'image_id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a33d61e4b5e1376a6beba981044ec290', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0ffa7ae7524d26a7e95e093cc18ac8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21f99634cd886800b967a00151f09c658ef71cd4c99ed5666e07dca7bb24a91cb19977af8f02126d4aebe491500734b66172cc707a9bb440aa53a77366f2781d', 'id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 18, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 18, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/625cb7ca-912b-4747-ba8e-3251bc009d8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45af530>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a692cb-d5cc-4350-8441-1b4edfd404bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a692cb-d5cc-4350-8441-1b4edfd404bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c87b4e-b087-471e-9ed6-f89285e621f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Volume 30b192b2-9deb-4453-a229-446cfb8899e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30b192b2-9deb-4453-a229-446cfb8899e4', 'volume_size': 1, 'image_id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a33d61e4b5e1376a6beba981044ec290', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0ffa7ae7524d26a7e95e093cc18ac8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21f99634cd886800b967a00151f09c658ef71cd4c99ed5666e07dca7bb24a91cb19977af8f02126d4aebe491500734b66172cc707a9bb440aa53a77366f2781d', 'id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 18, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 18, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/625cb7ca-912b-4747-ba8e-3251bc009d8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45af530>}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Trying to clone 30b192b2-9deb-4453-a229-446cfb8899e4 from image 625cb7ca-912b-4747-ba8e-3251bc009d8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:18:45 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[43902348-e53b-4554-8b36-42aeed27eb24]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:45 devstack sudo[95219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:45 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:45 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 1073741824" returned: 0 in 0.655s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:45 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:18:45 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:45 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:45 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:45 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:46 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328eff5c-f1e0-44a9-b6c6-7fa78003451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc6a781-ed08-489b-a73a-583630d70192', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4f3d2b-9c2d-4584-b621-300b4ac4ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:46 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Volume volume-fbc6a781-ed08-489b-a73a-583630d70192 (fbc6a781-ed08-489b-a73a-583630d70192): created successfully
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4f3d2b-9c2d-4584-b621-300b4ac4ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Flow 'volume_create_manager' (05d3fac3-795d-4157-bc58-2a830e4bb868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e3f43d70-994b-4e81-872a-742033a7fda2 tempest-VolumesActionsTest-1385206314 None] Created volume successfully.
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e54066-ca5f-4870-8861-3e2ec0ebd772]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:46 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Temporary image 625cb7ca-912b-4747-ba8e-3251bc009d8c is fetched for user 398e2e9710164e8e80d203306b719e6a. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c044af3-fa6c-4aaf-92cd-a61a7a78a354]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:46 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c
Sep 23 00:18:46 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:46 devstack sudo[95235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:46 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:46 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c" returned: 0 in 0.623s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:46 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:46 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c
Sep 23 00:18:46 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:47 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:47 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:47 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cad3650-4f94-4058-bdfa-bb9b6856b84c" returned: 0 in 0.539s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-7cad3650-4f94-4058-bdfa-bb9b6856b84c" released by "delete_volume" :: held 1.239s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['19f266c6-bd9a-427c-b330-da825e03e6c8'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:47 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b192b2-9deb-4453-a229-446cfb8899e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0ffa7ae7524d26a7e95e093cc18ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:44Z,use_quota=True,user_id='398e2e9710164e8e80d203306b719e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c22595a-3ee1-4c00-be54-0bc01527582c),volume_type_id=8c22595a-3ee1-4c00-be54-0bc01527582c)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Creating volume 30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:18:47 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:47 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1073741824
Sep 23 00:18:47 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:47 devstack cinder-volume[86631]: WARNING cinder.quota [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-343206414 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-343206414, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:47 devstack cinder-volume[86631]: WARNING cinder.quota [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-343206414 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-343206414, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:47 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['999faa86-ae6b-4a9a-9db3-27a375df0c3a', 'c3ac022b-f2a6-4e53-b98d-a0f59376b52a', '4041377c-8e34-464a-9e10-cce9a9c7d5f5', 'c881c533-df4b-4f29-9049-c95bb20f3a46'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:48 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:48 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:48 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1073741824" returned: 0 in 1.223s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:49 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.924s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:49 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4
Sep 23 00:18:49 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] group_snapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: deleting
Sep 23 00:18:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b2c5b7a8-efd2-4e5a-8afa-5b7b356d1fc1 tempest-GroupSnapshotsTest-1512656541 None] Delete group completed successfully.
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] group_snapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: deleting {{(pid=86631) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Deleting offline snapshot 3b833222-7ab2-4c3d-95f1-49892ba3268b of volume 824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] snapshot_file for this snap is: volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[70769140-c690-450b-a204-096f7014f46e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:49 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4" returned: 0 in 0.524s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Attempting download of 625cb7ca-912b-4747-ba8e-3251bc009d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}])) to volume 30b192b2-9deb-4453-a229-446cfb8899e4. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:18:49 devstack sudo[95337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:49 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af812f-ba40-4551-bbfb-3807b50f0974]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:50 devstack sudo[95340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96
Sep 23 00:18:50 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:50 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96" returned: 0 in 0.677s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:50 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 1.139s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a1b3c-bc8c-417b-a8e3-af469f2a284f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:50 devstack sudo[95347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96
Sep 23 00:18:50 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:50 devstack sudo[95348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:50 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:51 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96" returned: 1 in 0.595s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_625cb7ca-912b-4747-ba8e-3251bc009d8c_86oqxw96' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c073262b-1a9f-49a7-9626-83e388399f53]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:51 devstack sudo[95355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:51 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:51 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 1.043s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:51 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:51 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:51 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:52 devstack sudo[95362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD
Sep 23 00:18:52 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:52 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] 625cb7ca-912b-4747-ba8e-3251bc009d8c was raw, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:18:52 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 0.951s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:52 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4
Sep 23 00:18:52 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:52 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b
Sep 23 00:18:52 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:53 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7.3b833222-7ab2-4c3d-95f1-49892ba3268b" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-3b833222-7ab2-4c3d-95f1-49892ba3268b" released by "_delete_snapshot" :: held 4.098s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" released by "delete_snapshot" :: held 4.205s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:53 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4" returned: 0 in 1.171s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_625cb7ca-912b-4747-ba8e-3251bc009d8c_ja_z6dlwdevstack@QuobyteHD, size 0.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:18:53 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:18:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:53 devstack cinder-volume[86631]: WARNING cinder.quota [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-343206414 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-343206414, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['63dc94f4-8e1c-4919-a69e-14842a98f780', '7e6bb360-ed22-45cd-b01f-c9a5e1250137', 'ae469dec-dfbb-4aba-bb43-fae732e8980b', 'bb3ef947-6c58-4378-b4f6-96ae654d85ee'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:54 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1G
Sep 23 00:18:54 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3d4bb00b-418b-4b75-940f-6b5f0dded74b tempest-GroupSnapshotsTest-1512656541 None] group_snapshot ba0b1880-53e1-4b02-8b1e-1e23feb181a6: deleted successfully
Sep 23 00:18:54 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 1G" returned: 0 in 0.812s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Downloaded image 625cb7ca-912b-4747-ba8e-3251bc009d8c ((None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}])) to volume 30b192b2-9deb-4453-a229-446cfb8899e4 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Temporary image 625cb7ca-912b-4747-ba8e-3251bc009d8c for user 398e2e9710164e8e80d203306b719e6a is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Marking volume 30b192b2-9deb-4453-a229-446cfb8899e4 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Copying metadata from image 625cb7ca-912b-4747-ba8e-3251bc009d8c to 30b192b2-9deb-4453-a229-446cfb8899e4. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Creating volume glance metadata for volume 30b192b2-9deb-4453-a229-446cfb8899e4 backed by image 625cb7ca-912b-4747-ba8e-3251bc009d8c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a33d61e4b5e1376a6beba981044ec290', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c87b4e-b087-471e-9ed6-f89285e621f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b192b2-9deb-4453-a229-446cfb8899e4', 'volume_size': 1, 'image_id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/625cb7ca-912b-4747-ba8e-3251bc009d8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a33d61e4b5e1376a6beba981044ec290', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0ffa7ae7524d26a7e95e093cc18ac8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21f99634cd886800b967a00151f09c658ef71cd4c99ed5666e07dca7bb24a91cb19977af8f02126d4aebe491500734b66172cc707a9bb440aa53a77366f2781d', 'id': '625cb7ca-912b-4747-ba8e-3251bc009d8c', 'created_at': datetime.datetime(2026, 9, 22, 22, 18, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 18, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/625cb7ca-912b-4747-ba8e-3251bc009d8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45af530>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35062ce-2660-4981-b971-09b2c52c73f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:18:55 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Volume volume-30b192b2-9deb-4453-a229-446cfb8899e4 (30b192b2-9deb-4453-a229-446cfb8899e4): created successfully
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35062ce-2660-4981-b971-09b2c52c73f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Flow 'volume_create_manager' (834e0e83-ce41-4160-bcbd-4778819af019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3a54921d-25cc-4f7c-995d-f7b70842b107 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Created volume successfully.
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" acquired by "delete_volume" :: waited 0.061s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd5d28f-374b-4d7d-abad-9d4f78119dc9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:55 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:55 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 0.917s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:56 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7
Sep 23 00:18:56 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Acquiring lock "cinder-30b192b2-9deb-4453-a229-446cfb8899e4-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "cinder-30b192b2-9deb-4453-a229-446cfb8899e4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Acquiring lock "cinder-quobyte-30b192b2-9deb-4453-a229-446cfb8899e4" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "cinder-quobyte-30b192b2-9deb-4453-a229-446cfb8899e4" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1091cf-73e1-44af-88fe-20c28942dbfe]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:56 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4
Sep 23 00:18:56 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:57 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" returned: 0 in 0.807s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:57 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:57 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-824043d8-a0c7-4024-9c7a-0ce1ab755fd7" released by "delete_volume" :: held 1.879s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['45830e94-337c-48b2-8621-6b14a8ca08f6'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:57 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:57 devstack cinder-volume[86631]: WARNING cinder.db.api [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-343206414']
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.481s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['1cd5c6e1-88f8-44cc-915c-7deab2694192', 'f4e9b64c-9c5b-4789-a1b2-5eea9dabde60', '57f9c511-efa9-4ca5-905d-a91238e54334', '755041e5-d3e8-4aa7-b234-39d3a2379f5c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:18:57 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4" returned: 0 in 1.075s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:57 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4
Sep 23 00:18:57 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:57 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:57 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:58 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.704s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:58 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:18:58 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7cc4d1c4-009a-45e7-9bc6-10da0a264ef2 tempest-GroupSnapshotsTest-1512656541 None] Delete group completed successfully.
Sep 23 00:18:58 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30b192b2-9deb-4453-a229-446cfb8899e4" returned: 0 in 0.975s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "cinder-quobyte-30b192b2-9deb-4453-a229-446cfb8899e4" released by "delete_volume" :: held 2.242s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:18:58 devstack cinder-volume[86631]: WARNING cinder.quota [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:58 devstack cinder-volume[86631]: WARNING cinder.quota [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:18:58 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Created reservations ['5f9c1426-0c6c-4ff9-827a-11f4c92f2661', '75ec4fed-6df8-4d38-9a54-39e15aa78346', '5d3f3bd3-cb00-47fa-af16-f217c306de25', 'f7e4dd41-74af-4da2-907f-25bcf2ea85d0'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:18:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e9f581c-4d8c-4ed4-abf0-8f0e7ab88804 tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-490660773: creating
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:18:59 devstack sudo[95444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:18:59 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:18:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e9f581c-4d8c-4ed4-abf0-8f0e7ab88804 tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-490660773: created successfully
Sep 23 00:18:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e9f581c-4d8c-4ed4-abf0-8f0e7ab88804 tempest-GroupSnapshotsTest-1512656541 None] Create group completed successfully.
Sep 23 00:18:59 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.611s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:18:59 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:00 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Deleted volume successfully.
Sep 23 00:19:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13547db0-f49c-4e61-8744-232a2158e4f0 tempest-VolumeAndVolumeTypeFromImageTest-7537622 None] Lock "cinder-30b192b2-9deb-4453-a229-446cfb8899e4-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (7a9e9a59-db61-49b1-8179-7c820f9d40f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad5cf1-bda1-440c-93f6-cbb39200494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad5cf1-bda1-440c-93f6-cbb39200494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52206984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94cec209-462a-4f04-86b4-b277e59ce8e5,host='devstack@QuobyteHD#QuobyteHD',id=c14e975a-8d8f-41d0-9b59-54681fd264de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:02Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a56a2de-54f3-4895-a528-37f889770bbb),volume_type_id=6a56a2de-54f3-4895-a528-37f889770bbb)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293a4e8-f185-4b9c-8b96-18aea99bc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293a4e8-f185-4b9c-8b96-18aea99bc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c0c2f0-b346-4c16-99a1-9841f92f39c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c0c2f0-b346-4c16-99a1-9841f92f39c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14e975a-8d8f-41d0-9b59-54681fd264de', 'volume_name': 'volume-c14e975a-8d8f-41d0-9b59-54681fd264de', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e37dc-7498-465f-982f-d6a1759dbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e37dc-7498-465f-982f-d6a1759dbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b91f6-4452-43be-8a1f-b4b5266d3304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:03 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Volume c14e975a-8d8f-41d0-9b59-54681fd264de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14e975a-8d8f-41d0-9b59-54681fd264de', 'volume_size': 1}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94cec209-462a-4f04-86b4-b277e59ce8e5,created_at=2026-09-22T22:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52206984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94cec209-462a-4f04-86b4-b277e59ce8e5,host='devstack@QuobyteHD#QuobyteHD',id=c14e975a-8d8f-41d0-9b59-54681fd264de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:02Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a56a2de-54f3-4895-a528-37f889770bbb),volume_type_id=6a56a2de-54f3-4895-a528-37f889770bbb)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Creating volume c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:03 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:03 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de 1073741824
Sep 23 00:19:03 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:04 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de 1073741824" returned: 0 in 1.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:04 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de
Sep 23 00:19:04 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:05 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de" returned: 0 in 0.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40b91f6-4452-43be-8a1f-b4b5266d3304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14e975a-8d8f-41d0-9b59-54681fd264de', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fa4c84-8cfa-480d-ac16-c93884d7c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Volume volume-c14e975a-8d8f-41d0-9b59-54681fd264de (c14e975a-8d8f-41d0-9b59-54681fd264de): created successfully
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fa4c84-8cfa-480d-ac16-c93884d7c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (7a9e9a59-db61-49b1-8179-7c820f9d40f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b3170b5c-61cd-4575-bc5c-4f6d72c73141 tempest-GroupSnapshotsTest-1512656541 None] Created volume successfully.
Sep 23 00:19:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f09cdd15-ba17-47ae-9c20-f6df78f5d468 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" by "attach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f09cdd15-ba17-47ae-9c20-f6df78f5d468 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" acquired by "attach_volume" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f09cdd15-ba17-47ae-9c20-f6df78f5d468 tempest-VolumesActionsTest-1385206314 None] Attaching volume fbc6a781-ed08-489b-a73a-583630d70192 to instance f0a60894-7975-4e42-952c-5cbea1659d39 at mountpoint /dev/vdb on host None.
Sep 23 00:19:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f09cdd15-ba17-47ae-9c20-f6df78f5d468 tempest-VolumesActionsTest-1385206314 None] Attach volume completed successfully.
Sep 23 00:19:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f09cdd15-ba17-47ae-9c20-f6df78f5d468 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" released by "attach_volume" :: held 0.237s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ae6df20-6d7c-4481-b3fa-00c6874d41fe tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" by "detach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ae6df20-6d7c-4481-b3fa-00c6874d41fe tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2ae6df20-6d7c-4481-b3fa-00c6874d41fe tempest-VolumesActionsTest-1385206314 None] Detaching volume fbc6a781-ed08-489b-a73a-583630d70192 from instance f0a60894-7975-4e42-952c-5cbea1659d39.
Sep 23 00:19:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2ae6df20-6d7c-4481-b3fa-00c6874d41fe tempest-VolumesActionsTest-1385206314 None] Detach volume completed successfully.
Sep 23 00:19:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ae6df20-6d7c-4481-b3fa-00c6874d41fe tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (fee7d9ba-af32-47bc-b457-f26c3183a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e721a6b-5cbf-4289-80db-4c2a012a435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e721a6b-5cbf-4289-80db-4c2a012a435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111434087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94cec209-462a-4f04-86b4-b277e59ce8e5,host='devstack@QuobyteHD#QuobyteHD',id=85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:09Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a56a2de-54f3-4895-a528-37f889770bbb),volume_type_id=6a56a2de-54f3-4895-a528-37f889770bbb)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee2d8a-29c6-4107-b64b-00a7fb2235d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee2d8a-29c6-4107-b64b-00a7fb2235d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47b6fcb-050c-49d7-9b0f-709377ae8e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47b6fcb-050c-49d7-9b0f-709377ae8e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f', 'volume_name': 'volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb3fcac-d008-490c-928c-1e2d8e3e776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb3fcac-d008-490c-928c-1e2d8e3e776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43effa9f-1269-436d-88eb-6f7caa3de237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Volume 85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f', 'volume_size': 1}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94cec209-462a-4f04-86b4-b277e59ce8e5,created_at=2026-09-22T22:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111434087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94cec209-462a-4f04-86b4-b277e59ce8e5,host='devstack@QuobyteHD#QuobyteHD',id=85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:09Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a56a2de-54f3-4895-a528-37f889770bbb),volume_type_id=6a56a2de-54f3-4895-a528-37f889770bbb)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Creating volume 85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:09 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:09 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f 1073741824
Sep 23 00:19:09 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:10 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f 1073741824" returned: 0 in 1.248s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:10 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f
Sep 23 00:19:10 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:11 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" returned: 0 in 0.504s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43effa9f-1269-436d-88eb-6f7caa3de237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e5080c-ba87-4324-b70a-644f5879dadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Volume volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f (85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f): created successfully
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e5080c-ba87-4324-b70a-644f5879dadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (fee7d9ba-af32-47bc-b457-f26c3183a35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ec26408f-f5a7-4f19-8f23-ead37c683a22 tempest-GroupSnapshotsTest-1512656541 None] Created volume successfully.
Sep 23 00:19:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-98339977-2722-4333-8db2-0fa044b175f3 tempest-GroupSnapshotsTest-1512656541 None] Update group completed successfully.
Sep 23 00:19:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2fc9b41f-1f2c-4d32-852e-cabf6431c658 tempest-GroupSnapshotsTest-1512656541 None] Update group completed successfully.
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (4cf42ebe-3a73-417b-9f37-8029f5cb85ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982591f2-fd27-45b5-aa66-fbf121fe236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982591f2-fd27-45b5-aa66-fbf121fe236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44561845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc845c1-452c-4e55-ae04-45a770e0c254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2defcd1c-838f-4954-85b3-30dfd6bf2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2defcd1c-838f-4954-85b3-30dfd6bf2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542ac5c1-6267-43cc-9205-cc7eaabf2ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542ac5c1-6267-43cc-9205-cc7eaabf2ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc845c1-452c-4e55-ae04-45a770e0c254', 'volume_name': 'volume-bbc845c1-452c-4e55-ae04-45a770e0c254', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480052d3-1d1a-42ce-b6f3-669877b21f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480052d3-1d1a-42ce-b6f3-669877b21f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2767f90-6fca-4bbe-b649-d46335cbb55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:14 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume bbc845c1-452c-4e55-ae04-45a770e0c254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc845c1-452c-4e55-ae04-45a770e0c254', 'volume_size': 1}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44561845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc845c1-452c-4e55-ae04-45a770e0c254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:14Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume bbc845c1-452c-4e55-ae04-45a770e0c254 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:14 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:14 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 1073741824
Sep 23 00:19:14 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d7719444-807e-4f09-a762-829c164c4b1c tempest-GroupSnapshotsTest-1512656541 None] Update group completed successfully.
Sep 23 00:19:15 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 1073741824" returned: 0 in 0.882s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:15 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254
Sep 23 00:19:15 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:15 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254" returned: 0 in 0.442s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2767f90-6fca-4bbe-b649-d46335cbb55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc845c1-452c-4e55-ae04-45a770e0c254', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9fd50b-c62a-4ff7-b623-1dec093e5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:15 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-bbc845c1-452c-4e55-ae04-45a770e0c254 (bbc845c1-452c-4e55-ae04-45a770e0c254): created successfully
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9fd50b-c62a-4ff7-b623-1dec093e5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (4cf42ebe-3a73-417b-9f37-8029f5cb85ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-dc28f17e-2c17-4121-9b6a-61b37f1bbb0c tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-80b04cfa-7b2f-4997-a305-a10ca6ba6fe5 tempest-GroupSnapshotsTest-1512656541 None] Update group completed successfully.
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (4db7f6ee-ae46-4ffa-bf6d-36624cae5419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9c962a-e47e-443e-bbb8-1c659096621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9c962a-e47e-443e-bbb8-1c659096621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355266617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47475085-acb8-46fe-9832-80aa458cdafb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:17Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436bc61-2016-407d-bcb3-855f6ceccecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436bc61-2016-407d-bcb3-855f6ceccecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9826897d-4d6f-4681-ae80-7b89100b3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9826897d-4d6f-4681-ae80-7b89100b3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47475085-acb8-46fe-9832-80aa458cdafb', 'volume_name': 'volume-47475085-acb8-46fe-9832-80aa458cdafb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f991e07-e3d9-40c2-9c3b-5a61a653cf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f991e07-e3d9-40c2-9c3b-5a61a653cf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a898f11f-e791-460a-8eef-75728e024c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume 47475085-acb8-46fe-9832-80aa458cdafb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47475085-acb8-46fe-9832-80aa458cdafb', 'volume_size': 1}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355266617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47475085-acb8-46fe-9832-80aa458cdafb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:17Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume 47475085-acb8-46fe-9832-80aa458cdafb {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:17 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:17 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb 1073741824
Sep 23 00:19:17 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (20882230-91ee-4340-a4aa-a5b9f7237b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22759cfa-f5b3-41b5-aba0-8b300cfee97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22759cfa-f5b3-41b5-aba0-8b300cfee97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66529376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49046d9-cb25-4189-a208-b27c1d96950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:18Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0192b2a-2168-485f-8ea4-a590d0cfc4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0192b2a-2168-485f-8ea4-a590d0cfc4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f072ee4-94d7-44cc-9b10-ca32d5773e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f072ee4-94d7-44cc-9b10-ca32d5773e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49046d9-cb25-4189-a208-b27c1d96950f', 'volume_name': 'volume-b49046d9-cb25-4189-a208-b27c1d96950f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47051a7f-5ea7-4c02-bbab-77cc449f698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47051a7f-5ea7-4c02-bbab-77cc449f698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339de2c2-03ea-4d60-8967-8bd81abcbaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:18 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume b49046d9-cb25-4189-a208-b27c1d96950f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49046d9-cb25-4189-a208-b27c1d96950f', 'volume_size': 1}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:18 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb 1073741824" returned: 0 in 0.879s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:18 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb
Sep 23 00:19:18 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:19 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (50441b38-c0bd-44c4-abec-fa5dc1deeb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d215cf-a691-4c95-ac39-95862fa94b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb" returned: 0 in 0.811s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66529376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49046d9-cb25-4189-a208-b27c1d96950f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:18Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume b49046d9-cb25-4189-a208-b27c1d96950f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a898f11f-e791-460a-8eef-75728e024c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47475085-acb8-46fe-9832-80aa458cdafb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ff7bf-f70e-4e5c-9982-b78568f74876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack sudo[95690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f 1073741824
Sep 23 00:19:19 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d215cf-a691-4c95-ac39-95862fa94b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687526001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9248e7-2f86-4b54-98fa-3c024a75b52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2939af-da34-4f7a-b9cc-b82ea3240d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2939af-da34-4f7a-b9cc-b82ea3240d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ded418f-641d-46d3-b273-dd921e058f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ded418f-641d-46d3-b273-dd921e058f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9248e7-2f86-4b54-98fa-3c024a75b52e', 'volume_name': 'volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ea596-ce25-435c-9587-5ff87755808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ea596-ce25-435c-9587-5ff87755808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278e231a-0045-4cee-b5d0-62b841d0d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume 6f9248e7-2f86-4b54-98fa-3c024a75b52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e', 'volume_size': 1}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-47475085-acb8-46fe-9832-80aa458cdafb (47475085-acb8-46fe-9832-80aa458cdafb): created successfully
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ff7bf-f70e-4e5c-9982-b78568f74876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (4db7f6ee-ae46-4ffa-bf6d-36624cae5419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] GroupSnapshot fced2841-116c-433d-9755-f0befede6eda: creating.
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-497e318b-5d57-4d4d-bfef-eb7d70348da1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Group snapshot fced2841-116c-433d-9755-f0befede6eda: creating. {{(pid=86631) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Flow 'volume_create_manager' (61910013-a2d4-4ba9-82b3-be005e7b1d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdf70f2-ddb8-4410-bc04-a9553c0b0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdf70f2-ddb8-4410-bc04-a9553c0b0950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2103822149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b40894-a68d-46bf-a1da-461840888cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18168a532c145dfb1c75e19ac79233b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='cc29af47b8c34634a6cc3023e014cebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94453819-8f3f-4b24-8f37-c3883e5c9943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94453819-8f3f-4b24-8f37-c3883e5c9943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c41d5dd-b9f6-4548-8532-02b4864abd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c41d5dd-b9f6-4548-8532-02b4864abd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b40894-a68d-46bf-a1da-461840888cd1', 'volume_name': 'volume-06b40894-a68d-46bf-a1da-461840888cd1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be4c71a-216f-4a33-9123-47487ced856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be4c71a-216f-4a33-9123-47487ced856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7133fa29-e3c1-4387-950a-c5960762838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Volume 06b40894-a68d-46bf-a1da-461840888cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b40894-a68d-46bf-a1da-461840888cd1', 'volume_size': 1}
Sep 23 00:19:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:20 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f 1073741824" returned: 0 in 0.970s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:20 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f
Sep 23 00:19:20 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (b2e28d8a-9019-441c-b49e-100696bdb463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c8003a-0c18-4afe-a4ca-d29904102653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c8003a-0c18-4afe-a4ca-d29904102653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320918194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601c311b-0034-4842-b72b-600342ea2ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:20Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e2d832-7523-444d-bb81-302087e8feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e2d832-7523-444d-bb81-302087e8feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ecb62-efbb-467b-b5de-987a824c6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ecb62-efbb-467b-b5de-987a824c6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601c311b-0034-4842-b72b-600342ea2ec9', 'volume_name': 'volume-601c311b-0034-4842-b72b-600342ea2ec9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccbfe05-4d10-4d36-9d69-43312ccdb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccbfe05-4d10-4d36-9d69-43312ccdb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f4f0dd-09ac-49a2-a0a7-1a60ba1e26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume 601c311b-0034-4842-b72b-600342ea2ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601c311b-0034-4842-b72b-600342ea2ec9', 'volume_size': 1}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:20 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f" returned: 0 in 0.455s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687526001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9248e7-2f86-4b54-98fa-3c024a75b52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume 6f9248e7-2f86-4b54-98fa-3c024a75b52e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:20 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:20 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e 1073741824
Sep 23 00:19:20 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339de2c2-03ea-4d60-8967-8bd81abcbaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49046d9-cb25-4189-a208-b27c1d96950f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aabbf1e-8df5-485c-863c-4390e94d8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-b49046d9-cb25-4189-a208-b27c1d96950f (b49046d9-cb25-4189-a208-b27c1d96950f): created successfully
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aabbf1e-8df5-485c-863c-4390e94d8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (20882230-91ee-4340-a4aa-a5b9f7237b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-af5bd305-b76d-44fb-a925-6e2c9275a4dc tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (403acb01-e1c8-4991-80d0-acce2a7633b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cd20dd-9784-4b12-a0db-8c99e3ce5432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cd20dd-9784-4b12-a0db-8c99e3ce5432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407515300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c436a3-27f2-4cf8-a49c-ba97f91ddc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:21Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66501ebf-cc9a-4f9a-be54-bd7970e93d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66501ebf-cc9a-4f9a-be54-bd7970e93d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965d77a5-2fcb-4d49-831b-cf56b1c37bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965d77a5-2fcb-4d49-831b-cf56b1c37bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c436a3-27f2-4cf8-a49c-ba97f91ddc06', 'volume_name': 'volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b78fb3-b9d2-4dd4-89fd-1d947d4c4ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b78fb3-b9d2-4dd4-89fd-1d947d4c4ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b141717-9646-4498-b63f-184ed5ae0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume c1c436a3-27f2-4cf8-a49c-ba97f91ddc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06', 'volume_size': 1}
Sep 23 00:19:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:21 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e 1073741824" returned: 0 in 0.597s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:21 devstack sudo[95717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e
Sep 23 00:19:21 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:21 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e" returned: 0 in 0.377s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.106s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278e231a-0045-4cee-b5d0-62b841d0d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9b50c-475d-4352-8a2b-aaee7fff689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Creating offline snapshot 24836c9a-9cd8-478b-a1f2-9e17620816f4 of volume 85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24495dd-aa89-4aea-a8f8-e014367514f2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:21 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e (6f9248e7-2f86-4b54-98fa-3c024a75b52e): created successfully
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9b50c-475d-4352-8a2b-aaee7fff689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (50441b38-c0bd-44c4-abec-fa5dc1deeb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-dc5d1377-3da7-4dfe-9e2e-a66c78059420 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:22 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f
Sep 23 00:19:22 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:22 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" returned: 0 in 0.512s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:22 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 1G
Sep 23 00:19:22 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:23 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 1G" returned: 0 in 0.812s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:23 devstack sudo[95773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4
Sep 23 00:19:23 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:23 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4" returned: 0 in 0.738s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:23 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4
Sep 23 00:19:23 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:24 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:24 devstack sudo[95808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info
Sep 23 00:19:24 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:24 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info" returned: 0 in 0.335s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:24 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:24 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info
Sep 23 00:19:24 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:25 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.info" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.408s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Creating offline snapshot 4e5430d7-28ef-4a52-aa13-f931dc2f9862 of volume c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[46597017-6b37-46b7-b5cb-6ada234dfa5d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:25 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de
Sep 23 00:19:25 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:25 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de" returned: 0 in 0.508s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:25 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 1G
Sep 23 00:19:25 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:26 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 1G" returned: 0 in 0.660s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14e975a-8d8f-41d0-9b59-54681fd264de -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:26 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14e975a-8d8f-41d0-9b59-54681fd264de -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862
Sep 23 00:19:26 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-58d66635-bc01-4e00-91c5-8e010982d745 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" by "attach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-58d66635-bc01-4e00-91c5-8e010982d745 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" acquired by "attach_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-58d66635-bc01-4e00-91c5-8e010982d745 tempest-VolumesActionsTest-1385206314 None] Attaching volume fbc6a781-ed08-489b-a73a-583630d70192 to instance 59f520c6-8c58-4e71-b7c2-43040493cee5 at mountpoint /dev/vdb on host None.
Sep 23 00:19:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-58d66635-bc01-4e00-91c5-8e010982d745 tempest-VolumesActionsTest-1385206314 None] Attach volume completed successfully.
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-58d66635-bc01-4e00-91c5-8e010982d745 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192" released by "attach_volume" :: held 0.122s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:26 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14e975a-8d8f-41d0-9b59-54681fd264de -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862" returned: 0 in 0.457s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:26 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:26 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862
Sep 23 00:19:26 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:27 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862" returned: 0 in 0.380s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:27 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info
Sep 23 00:19:27 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bc1151bc-ba0a-4b08-988b-eb2857859b01 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" by "detach_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bc1151bc-ba0a-4b08-988b-eb2857859b01 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bc1151bc-ba0a-4b08-988b-eb2857859b01 tempest-VolumesActionsTest-1385206314 None] Detaching volume fbc6a781-ed08-489b-a73a-583630d70192 from instance 59f520c6-8c58-4e71-b7c2-43040493cee5.
Sep 23 00:19:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bc1151bc-ba0a-4b08-988b-eb2857859b01 tempest-VolumesActionsTest-1385206314 None] Detach volume completed successfully.
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bc1151bc-ba0a-4b08-988b-eb2857859b01 tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:27 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:27 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:19:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:27 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info
Sep 23 00:19:27 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:28 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.info" returned: 0 in 0.439s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.972s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.691s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320918194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601c311b-0034-4842-b72b-600342ea2ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:20Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume 601c311b-0034-4842-b72b-600342ea2ec9 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:28 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:28 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 1073741824
Sep 23 00:19:28 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9d41965d-b955-45a3-805b-ba3482ab1ea1 tempest-GroupSnapshotsTest-1512656541 None] group_snapshot fced2841-116c-433d-9755-f0befede6eda: created successfully
Sep 23 00:19:28 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 1073741824" returned: 0 in 0.805s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:29 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9
Sep 23 00:19:29 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:29 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9" returned: 0 in 0.307s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.307s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407515300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c436a3-27f2-4cf8-a49c-ba97f91ddc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3cab0dc4a4be3972cb935dd45f0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:21Z,use_quota=True,user_id='d9f789207b2d49828625263a734a749e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Creating volume c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:29 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f4f0dd-09ac-49a2-a0a7-1a60ba1e26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601c311b-0034-4842-b72b-600342ea2ec9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4707c038-4b8b-4ba4-a2c5-5962ecf3dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:29 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 1073741824
Sep 23 00:19:29 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:29 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-601c311b-0034-4842-b72b-600342ea2ec9 (601c311b-0034-4842-b72b-600342ea2ec9): created successfully
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4707c038-4b8b-4ba4-a2c5-5962ecf3dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (b2e28d8a-9019-441c-b49e-100696bdb463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-deda8f74-f82c-4955-b614-7f16c39b7919 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] group_snapshot fced2841-116c-433d-9755-f0befede6eda: deleting
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] group_snapshot fced2841-116c-433d-9755-f0befede6eda: deleting {{(pid=86631) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-24836c9a-9cd8-478b-a1f2-9e17620816f4" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-24836c9a-9cd8-478b-a1f2-9e17620816f4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Deleting offline snapshot 24836c9a-9cd8-478b-a1f2-9e17620816f4 of volume 85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] snapshot_file for this snap is: volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1d94d-dbe9-40ea-b690-376f02967f98]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:29 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4
Sep 23 00:19:29 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:30 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 1073741824" returned: 0 in 0.904s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:30 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06
Sep 23 00:19:30 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:30 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4" returned: 0 in 0.697s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[369d5c4f-eaf6-45d8-b444-5498b9476f48]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:30 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f
Sep 23 00:19:30 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:30 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.841s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2103822149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b40894-a68d-46bf-a1da-461840888cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18168a532c145dfb1c75e19ac79233b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:19Z,use_quota=True,user_id='cc29af47b8c34634a6cc3023e014cebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Creating volume 06b40894-a68d-46bf-a1da-461840888cd1 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:19:30 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b141717-9646-4498-b63f-184ed5ae0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:30 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 1073741824
Sep 23 00:19:30 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108d543-0d23-4aa5-9408-ba5cca81b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Volume volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 (c1c436a3-27f2-4cf8-a49c-ba97f91ddc06): created successfully
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108d543-0d23-4aa5-9408-ba5cca81b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Flow 'volume_create_manager' (403acb01-e1c8-4991-80d0-acce2a7633b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1f05aba6-c2b2-4ea7-8aa9-379283b84af1 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created volume successfully.
Sep 23 00:19:31 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" returned: 0 in 0.669s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:31 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4
Sep 23 00:19:31 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:31 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 1073741824" returned: 0 in 0.823s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce69cbb-9a5a-456b-b466-2d308f1c9865]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:31 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1
Sep 23 00:19:31 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:31 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4" returned: 0 in 0.649s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:31 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06
Sep 23 00:19:31 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:31 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4
Sep 23 00:19:31 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:31 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1" returned: 0 in 0.384s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7133fa29-e3c1-4387-950a-c5960762838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b40894-a68d-46bf-a1da-461840888cd1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896184de-c40b-4ea7-9075-5d3622c2b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Volume volume-06b40894-a68d-46bf-a1da-461840888cd1 (06b40894-a68d-46bf-a1da-461840888cd1): created successfully
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896184de-c40b-4ea7-9075-5d3622c2b65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Flow 'volume_create_manager' (61910013-a2d4-4ba9-82b3-be005e7b1d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1b75d446-d26e-41d5-ae32-79cd673efb90 tempest-ServersNegativeTestJSON-2133608649 None] Created volume successfully.
Sep 23 00:19:32 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f.24836c9a-9cd8-478b-a1f2-9e17620816f4" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:32 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" returned: 0 in 0.681s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-24836c9a-9cd8-478b-a1f2-9e17620816f4" released by "_delete_snapshot" :: held 2.710s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" released by "delete_snapshot" :: held 2.740s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:32 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06
Sep 23 00:19:32 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-4e5430d7-28ef-4a52-aa13-f931dc2f9862" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-4e5430d7-28ef-4a52-aa13-f931dc2f9862" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Deleting offline snapshot 4e5430d7-28ef-4a52-aa13-f931dc2f9862 of volume c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] snapshot_file for this snap is: volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7592461-ce22-474a-a214-96ba172a5743]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:32 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862
Sep 23 00:19:32 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:32 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06" released by "delete_volume" :: held 1.096s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['38520418-5dc3-4034-b983-57ad6336ddbb', '64935ed5-1c6a-42a2-82f4-b8c1d8b471c3', '5f186bc0-e4a0-4fbd-ade4-65246319b67a', 'b3d9cf38-2b27-4bf0-99df-77510586e6e7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:32 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:32 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:32 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862" returned: 0 in 0.526s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c14e975a-8d8f-41d0-9b59-54681fd264de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a513c2-39e8-44ce-a467-df2280c184b5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:33 devstack sudo[95928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de
Sep 23 00:19:33 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:33 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-702c8f4a-8f09-41f0-83d5-dc74a7b47e60 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-c1c436a3-27f2-4cf8-a49c-ba97f91ddc06-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:33 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de" returned: 0 in 0.619s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:33 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862
Sep 23 00:19:33 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-601c311b-0034-4842-b72b-600342ea2ec9-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-601c311b-0034-4842-b72b-600342ea2ec9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-601c311b-0034-4842-b72b-600342ea2ec9" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-601c311b-0034-4842-b72b-600342ea2ec9" acquired by "delete_volume" :: waited 0.061s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b80bca-f985-4b9b-8191-7e74d0baf4f9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[685509fa-a052-495b-9ffe-d3f1444c5a3d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:34 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:19:34 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:34 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862" returned: 0 in 0.565s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:34 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862
Sep 23 00:19:34 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:34 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9
Sep 23 00:19:34 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:34 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de.4e5430d7-28ef-4a52-aa13-f931dc2f9862" returned: 0 in 0.360s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-4e5430d7-28ef-4a52-aa13-f931dc2f9862" released by "_delete_snapshot" :: held 2.241s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" released by "delete_snapshot" :: held 2.274s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:34 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:34 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.639s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9" returned: 0 in 0.621s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d85dbd2-7f76-4181-bc0f-9c2825cf56d4]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:34 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9
Sep 23 00:19:34 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:34 devstack cinder-volume[86631]: WARNING cinder.quota [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1539470745 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1539470745, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:19:34 devstack cinder-volume[86631]: WARNING cinder.quota [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1539470745 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1539470745, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:19:34 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['df307a20-66df-4d46-a69c-1b77694e12f2', 'a191c33d-80fb-4f46-84c0-309b038090d9', '67dd8a59-37aa-43ff-845c-9f8ab80f85a5', '4b413b65-115b-4d48-9c2f-930d852d97bc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:34 devstack sudo[95957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:19:34 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['810aa880-0be1-4672-b347-f61a5e846999', 'b278e6fd-283b-483f-9c5c-1dab111b660e', '179ef345-deca-4a15-abfe-45d12cec4540', '727296a1-360f-463f-bab6-f3d91cc7b217'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:35 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-601c311b-0034-4842-b72b-600342ea2ec9" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-601c311b-0034-4842-b72b-600342ea2ec9" released by "delete_volume" :: held 1.174s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-425191bb-dfb0-4835-8f9b-32a53c7f0025 tempest-GroupSnapshotsTest-1512656541 None] group_snapshot fced2841-116c-433d-9755-f0befede6eda: deleted successfully
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['f03d8c89-480b-4db2-bb7c-abb3a86be45b', 'dc1424d4-b781-4c3b-a940-831a100f9ffa', '9dcfa5a2-5eed-4a9a-bd3a-8391da5e53ea', '134edcc3-aa51-4017-bc94-ef6cf0491806'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:35 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.631s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.1b417c38-14cb-4799-95a3-c02fc838ccc5v75h4qxk.img {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:35 devstack sudo[95964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.1b417c38-14cb-4799-95a3-c02fc838ccc5v75h4qxk.img
Sep 23 00:19:35 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:35 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:35 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Flow 'volume_create_manager' (de6ce034-42bc-46d6-8906-fcbbed3e9311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bab3d66-43b0-4a44-bd59-4fd1cfa98900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bab3d66-43b0-4a44-bd59-4fd1cfa98900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31032967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac34d4e1-19fb-44da-840a-9c7834223c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18168a532c145dfb1c75e19ac79233b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='cc29af47b8c34634a6cc3023e014cebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037bc7c-1773-4635-b89a-b1bae4e9a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a037bc7c-1773-4635-b89a-b1bae4e9a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78e645c-6a92-42ba-8130-7da4f3d3c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78e645c-6a92-42ba-8130-7da4f3d3c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac34d4e1-19fb-44da-840a-9c7834223c2e', 'volume_name': 'volume-ac34d4e1-19fb-44da-840a-9c7834223c2e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31708a91-c27e-4b7f-9224-a27d31ebc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31708a91-c27e-4b7f-9224-a27d31ebc9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eab21b2-fca0-40cb-b333-c9933e26bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Volume ac34d4e1-19fb-44da-840a-9c7834223c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac34d4e1-19fb-44da-840a-9c7834223c2e', 'volume_size': 1}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:35 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0189f584-cfe1-4097-bf27-d05ebbaf5e0e tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-601c311b-0034-4842-b72b-600342ea2ec9-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-6f9248e7-2f86-4b54-98fa-3c024a75b52e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-6f9248e7-2f86-4b54-98fa-3c024a75b52e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64932c-a83a-494f-a697-955615de09ee]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-6f9248e7-2f86-4b54-98fa-3c024a75b52e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-6f9248e7-2f86-4b54-98fa-3c024a75b52e" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1853342-0a5a-48c4-a348-c0241caecc6a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:37 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f
Sep 23 00:19:37 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:37 devstack sudo[95981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e
Sep 23 00:19:37 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:37 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" returned: 0 in 1.055s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:37 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f
Sep 23 00:19:37 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:37 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e" returned: 0 in 1.044s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:38 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e
Sep 23 00:19:38 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:38 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" returned: 0 in 0.658s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-85fd0ee0-c9cc-4e4e-b61b-c1d2ffe8cb9f" released by "delete_volume" :: held 1.997s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:38 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6f9248e7-2f86-4b54-98fa-3c024a75b52e" returned: 0 in 0.691s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-6f9248e7-2f86-4b54-98fa-3c024a75b52e" released by "delete_volume" :: held 1.843s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[51233b22-be45-4958-afd6-d56697d8ba06]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:38 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['1dcd96ea-221c-40ff-80e2-fb79a5b30678', '41f7547c-b98d-4638-bbea-a48bca8378d1', 'a62d2be0-0f19-464d-a460-516f540aee3d', '866bb02d-bef0-4966-8280-5a135d746f23'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:38 devstack sudo[96040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de
Sep 23 00:19:38 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:39 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:39 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:39 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de" returned: 0 in 0.669s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:39 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de
Sep 23 00:19:39 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-b49046d9-cb25-4189-a208-b27c1d96950f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-b49046d9-cb25-4189-a208-b27c1d96950f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-b49046d9-cb25-4189-a208-b27c1d96950f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-b49046d9-cb25-4189-a208-b27c1d96950f" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d68b0-2922-4284-83ee-fb2b6d757c42]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:40 devstack sudo[96050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f
Sep 23 00:19:40 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:40 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.881s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:40 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c14e975a-8d8f-41d0-9b59-54681fd264de" returned: 0 in 0.705s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-c14e975a-8d8f-41d0-9b59-54681fd264de" released by "delete_volume" :: held 1.585s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b781a3ed-be54-4726-a314-76f88ef4feee tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-6f9248e7-2f86-4b54-98fa-3c024a75b52e-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['09461c70-5d89-4db3-89a6-998e56be3211'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:40 devstack cinder-volume[86631]: WARNING cinder.quota [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1539470745 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1539470745, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['540be64e-4d6e-4ba8-b357-4c1f257e0f49', '8c5b57b5-ee3a-4fe5-81fc-c523a9f22883', 'd557d679-2fbf-4e06-ad44-d98a067a264e', '4c6980c2-7eaa-43a0-bb57-d479c5451760'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=136,cinder:SELECT=124,cinder:DELETE=6,cinder:INSERT=37 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:19:40 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f" returned: 0 in 0.865s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:40 devstack sudo[96057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f
Sep 23 00:19:40 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=133,cinder:UPDATE=131,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['8dce1ade-3070-43f1-bcff-8a3822e93926', '41a45b32-29c7-4a4e-9fa4-460af4d5d1fc', '70028235-f9a0-4df5-9933-e45125ffe6cc', '78510489-65cc-4d60-a8b7-81b4548d488e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:41 devstack sudo[96059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:41 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:41 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b49046d9-cb25-4189-a208-b27c1d96950f" returned: 0 in 0.539s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-b49046d9-cb25-4189-a208-b27c1d96950f" released by "delete_volume" :: held 1.537s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['36c593f0-702f-4fb5-957f-7ce125ed3d2c', 'c4894071-a7a6-49e4-9fc2-db06c806cb8a', 'd465df44-0f06-46bd-81f2-95aede3c9379', '5057b357-11dd-4d17-ad0b-e1914ba9b09f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:41 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.943s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:41 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:41 devstack sudo[96063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:41 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-332547ab-2868-4862-a8db-1bbc453f79d4 tempest-GroupSnapshotsTest-1512656541 None] Delete group completed successfully.
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-47475085-acb8-46fe-9832-80aa458cdafb-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-47475085-acb8-46fe-9832-80aa458cdafb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-47475085-acb8-46fe-9832-80aa458cdafb" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-47475085-acb8-46fe-9832-80aa458cdafb" acquired by "delete_volume" :: waited 0.054s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c8d4a-42df-40e7-95df-ceab9f8216d6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-040e5e63-db71-459d-89c9-e8fc481b07fc tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-218809973: creating
Sep 23 00:19:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-040e5e63-db71-459d-89c9-e8fc481b07fc tempest-GroupSnapshotsTest-1512656541 None] Group tempest-GroupSnapshotsTest-Group-218809973: created successfully
Sep 23 00:19:42 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.774s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-040e5e63-db71-459d-89c9-e8fc481b07fc tempest-GroupSnapshotsTest-1512656541 None] Create group completed successfully.
Sep 23 00:19:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-339e5f25-0e88-4912-b1f7-ca0810f491b2 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-b49046d9-cb25-4189-a208-b27c1d96950f-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:42 devstack sudo[96066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb
Sep 23 00:19:42 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:43 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb" returned: 0 in 0.725s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:43 devstack sudo[96073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb
Sep 23 00:19:43 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:43 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47475085-acb8-46fe-9832-80aa458cdafb" returned: 0 in 0.645s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-47475085-acb8-46fe-9832-80aa458cdafb" released by "delete_volume" :: held 1.501s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['3a8c3690-0e93-4dce-9f02-884b7d638894', '65cfd047-0735-4b88-b3c6-f5586368afc3', '7ae1721f-221b-46f3-b532-48ae7b89e498', '81fc738b-6cb7-4ddf-95a8-6c43dd1b66ce'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:44 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:44 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:44 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.1b417c38-14cb-4799-95a3-c02fc838ccc5v75h4qxk.img" returned: 0 in 9.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b024790-bf42-4910-b737-c0c3bbc052ea]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-bbc845c1-452c-4e55-ae04-45a770e0c254-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-bbc845c1-452c-4e55-ae04-45a770e0c254-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "cinder-quobyte-bbc845c1-452c-4e55-ae04-45a770e0c254" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-bbc845c1-452c-4e55-ae04-45a770e0c254" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:19:44 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.631s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad52154-eaea-45e4-92a0-d7199bc8d20c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:45 devstack sudo[96078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:19:45 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (4f97b965-f5b4-47f7-97e0-f7b45abd3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cf94f4-70d6-464f-8ec9-fc1b8574f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f8bac04d-38de-466f-a22b-32dfe0755bd9 tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-47475085-acb8-46fe-9832-80aa458cdafb-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cf94f4-70d6-464f-8ec9-fc1b8574f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845139563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92e3dca4-6de7-413d-b3cb-2d3906bed35e,host='devstack@QuobyteHD#QuobyteHD',id=da12a130-5ccd-4a92-a328-c294df74d2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:45Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b262d1d-9133-4f01-b9b8-971aff98ab64),volume_type_id=7b262d1d-9133-4f01-b9b8-971aff98ab64)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b2e3e7-53c5-4c0a-b7aa-44bc32ce0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b2e3e7-53c5-4c0a-b7aa-44bc32ce0080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da469348-4516-4451-a7b1-022e3d4d6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da469348-4516-4451-a7b1-022e3d4d6761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da12a130-5ccd-4a92-a328-c294df74d2e1', 'volume_name': 'volume-da12a130-5ccd-4a92-a328-c294df74d2e1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:45 devstack sudo[96080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254
Sep 23 00:19:45 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fd0ca3-7918-4a55-84dc-8867d535bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fd0ca3-7918-4a55-84dc-8867d535bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b966fe-e7a4-42b5-b2e7-71f19b8dcd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Volume da12a130-5ccd-4a92-a328-c294df74d2e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da12a130-5ccd-4a92-a328-c294df74d2e1', 'volume_size': 1}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:45 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254" returned: 0 in 0.490s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:45 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254
Sep 23 00:19:45 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:45 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.865s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192, size 1024.00 MB, duration 9.34 sec, destination /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.1b417c38-14cb-4799-95a3-c02fc838ccc5v75h4qxk.img {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:19:45 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Converted 1024.00 MB image at 109.69 MB/s
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] 1b417c38-14cb-4799-95a3-c02fc838ccc5 was raw, no need to convert to raw {{(pid=86631) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 23 00:19:45 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bbc845c1-452c-4e55-ae04-45a770e0c254" returned: 0 in 0.367s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-quobyte-bbc845c1-452c-4e55-ae04-45a770e0c254" released by "delete_volume" :: held 0.959s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:45 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Created reservations ['0e0ba2e0-a25a-4fec-876e-e07abe474e6c', '82a8907b-febe-491f-9f72-d5d602487a3a', '917b7222-a077-41ab-95ff-46d30d820a29', 'a01937df-e53e-4c76-9ae0-8d0b57eea803'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:46 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:46 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:46 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.391s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Deleted volume successfully.
Sep 23 00:19:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-673cdee1-f9e9-4a87-ac49-921dfb6b763a tempest-CreateVolumesFromSourceVolumeTest-1560155268 None] Lock "cinder-bbc845c1-452c-4e55-ae04-45a770e0c254-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Flow 'volume_create_manager' (c1db0e6f-d059-452a-bf82-454cbbc055b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fb5b9d-bc0c-42ce-b396-7e903ed07d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fb5b9d-bc0c-42ce-b396-7e903ed07d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5c285d-73b6-4caf-9a37-d84c8fbbd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a695f469f9ea49d69ae20af27b14d059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:53Z,use_quota=True,user_id='6aa5e0bb2736470bb0908cc73cd62441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b9d431-177c-4976-a76e-77f6fadc59cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b9d431-177c-4976-a76e-77f6fadc59cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9e376e-a063-4b6a-b5cf-bf91d00e5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9e376e-a063-4b6a-b5cf-bf91d00e5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed5c285d-73b6-4caf-9a37-d84c8fbbd843', 'volume_name': 'volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843', 'volume_size': 1, 'image_id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fa98f19d68d67723dbdbdd2f7053b27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a695f469f9ea49d69ae20af27b14d059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57b5a84866dc938a7c07407553d5f083c67c9f60b22ca70beb5d07c0875f30c7022945b7028a2c5719e97dfded02a2aaa0b9e7405e063fc21ba29f799f41693f', 'id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea1dbb60>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78c086-8d7e-4e38-9094-2a1ba44138a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78c086-8d7e-4e38-9094-2a1ba44138a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc13bc14-1513-4a6e-84b2-7fb161c3e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:19:53 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843', 'volume_size': 1, 'image_id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fa98f19d68d67723dbdbdd2f7053b27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a695f469f9ea49d69ae20af27b14d059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57b5a84866dc938a7c07407553d5f083c67c9f60b22ca70beb5d07c0875f30c7022945b7028a2c5719e97dfded02a2aaa0b9e7405e063fc21ba29f799f41693f', 'id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea1dbb60>}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Trying to clone ed5c285d-73b6-4caf-9a37-d84c8fbbd843 from image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 at location (None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:19:53 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69aceba-4c7a-4dcb-a667-9fa3c35c479e]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:53 devstack sudo[96100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:19:53 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:53 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:54 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:19:54 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:54 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Temporary image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 is fetched for user 6aa5e0bb2736470bb0908cc73cd62441. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92dee83-33fb-4137-a376-b5b726256b3b]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:54 devstack sudo[96109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:19:54 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:54 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:54 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:19:54 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:55 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:19:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:19:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:19:56 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:19:56 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:19:57 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Sep 23 00:19:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:19:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:19:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:19:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:19:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:20:04 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:20:04 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.160s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Uploaded volume to glance image-id: 1b417c38-14cb-4799-95a3-c02fc838ccc5. {{(pid=86631) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.608s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31032967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac34d4e1-19fb-44da-840a-9c7834223c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18168a532c145dfb1c75e19ac79233b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='cc29af47b8c34634a6cc3023e014cebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Creating volume ac34d4e1-19fb-44da-840a-9c7834223c2e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:09 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-cfcc87ea-b897-4fc9-9484-e921dd84a524 tempest-VolumesActionsTest-1385206314 None] Copy volume to image completed successfully.
Sep 23 00:20:09 devstack sudo[96123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e 1073741824
Sep 23 00:20:09 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:09 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e 1073741824" returned: 0 in 0.595s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:09 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e
Sep 23 00:20:09 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:10 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.871s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92e3dca4-6de7-413d-b3cb-2d3906bed35e,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845139563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92e3dca4-6de7-413d-b3cb-2d3906bed35e,host='devstack@QuobyteHD#QuobyteHD',id=da12a130-5ccd-4a92-a328-c294df74d2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c88d3f102d49d48a4bd92319d136cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:45Z,use_quota=True,user_id='458bfcd58e84408593524502ab926fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b262d1d-9133-4f01-b9b8-971aff98ab64),volume_type_id=7b262d1d-9133-4f01-b9b8-971aff98ab64)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Creating volume da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:10 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eab21b2-fca0-40cb-b333-c9933e26bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac34d4e1-19fb-44da-840a-9c7834223c2e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd2692f-585e-438c-8e92-6d60e0fb693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:10 devstack sudo[96132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 1073741824
Sep 23 00:20:10 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Volume volume-ac34d4e1-19fb-44da-840a-9c7834223c2e (ac34d4e1-19fb-44da-840a-9c7834223c2e): created successfully
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd2692f-585e-438c-8e92-6d60e0fb693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Flow 'volume_create_manager' (de6ce034-42bc-46d6-8906-fcbbed3e9311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-93a97e69-4b1b-4f52-8e54-251f49fa56c7 tempest-ServersNegativeTestJSON-2133608649 None] Created volume successfully.
Sep 23 00:20:10 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 1073741824" returned: 0 in 0.643s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:10 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1
Sep 23 00:20:10 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:11 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1" returned: 0 in 0.269s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.778s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5c285d-73b6-4caf-9a37-d84c8fbbd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a695f469f9ea49d69ae20af27b14d059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:53Z,use_quota=True,user_id='6aa5e0bb2736470bb0908cc73cd62441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Creating volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:11 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b966fe-e7a4-42b5-b2e7-71f19b8dcd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da12a130-5ccd-4a92-a328-c294df74d2e1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6be8d7b-fca1-45b8-8e18-265b459cd0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:11 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1073741824
Sep 23 00:20:11 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Volume volume-da12a130-5ccd-4a92-a328-c294df74d2e1 (da12a130-5ccd-4a92-a328-c294df74d2e1): created successfully
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6be8d7b-fca1-45b8-8e18-265b459cd0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Flow 'volume_create_manager' (4f97b965-f5b4-47f7-97e0-f7b45abd3247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8f974dd8-3e31-465e-9add-4df12c03a7bd tempest-GroupSnapshotsTest-1512656541 None] Created volume successfully.
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "cinder-ac34d4e1-19fb-44da-840a-9c7834223c2e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-ac34d4e1-19fb-44da-840a-9c7834223c2e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "cinder-quobyte-ac34d4e1-19fb-44da-840a-9c7834223c2e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-quobyte-ac34d4e1-19fb-44da-840a-9c7834223c2e" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e285a539-6b03-47ee-88c5-e7ccdd143f58]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:11 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1073741824" returned: 0 in 0.604s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:11 devstack sudo[96147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e
Sep 23 00:20:11 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:11 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843
Sep 23 00:20:11 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" returned: 0 in 0.287s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.252s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f871b582-c420-494c-b4c3-7af7c5d38ae3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Attempting download of 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 ((None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}])) to volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:20:12 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e" returned: 0 in 0.507s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e
Sep 23 00:20:12 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6938c56-b841-420a-ad50-716e1d089b34]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:20:12 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] GroupSnapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: creating.
Sep 23 00:20:12 devstack sudo[96158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4
Sep 23 00:20:12 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Group snapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: creating. {{(pid=86631) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:12 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ac34d4e1-19fb-44da-840a-9c7834223c2e" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-quobyte-ac34d4e1-19fb-44da-840a-9c7834223c2e" released by "delete_volume" :: held 0.912s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Created reservations ['13e1ad17-d430-4277-8026-245704137d1d', '3d9f4dca-c8ae-4779-b576-1586d82f8599', '352a0077-9965-4c12-9522-b3386a37f05b', 'b54ae03f-53ba-4c95-bd5b-122057825169'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:12 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.532s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ca311-9d5e-4bce-9840-1be9625a9baa]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:12 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4" returned: 0 in 0.545s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack sudo[96169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:12 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "cinder-06b40894-a68d-46bf-a1da-461840888cd1-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-06b40894-a68d-46bf-a1da-461840888cd1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:12 devstack sudo[96166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:20:12 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "cinder-quobyte-06b40894-a68d-46bf-a1da-461840888cd1" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-quobyte-06b40894-a68d-46bf-a1da-461840888cd1" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:12 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c23c03-0ebc-40b5-8a33-330f50b01a31]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:12 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack sudo[96174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1
Sep 23 00:20:13 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.365s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Deleted volume successfully.
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ab66814-9e57-4f8a-91bf-d1be481fa9d9 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-ac34d4e1-19fb-44da-840a-9c7834223c2e-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:13 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.549s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:13 devstack sudo[96180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img
Sep 23 00:20:13 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4" returned: 1 in 0.577s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_u68s_9a4' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0792ef27-8b5c-48a0-a69c-f8db7058b345]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:13 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:20:13 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1" returned: 0 in 0.708s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:13 devstack sudo[96194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1
Sep 23 00:20:13 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:13 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:14 devstack sudo[96204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD
Sep 23 00:20:14 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:14 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-06b40894-a68d-46bf-a1da-461840888cd1" returned: 0 in 0.570s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-quobyte-06b40894-a68d-46bf-a1da-461840888cd1" released by "delete_volume" :: held 1.360s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Created reservations ['86598d7c-ac3e-4581-94d0-8b80bb886be9', '630ee3ab-4b82-423d-b85e-3f4003cc9c41', '5b15ead9-76f0-41a4-910e-aa25010249a9', 'e2126082-0a55-430a-8c2e-1907b9c9d613'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:14 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD" returned: 1 in 0.610s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 was raw, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:14 devstack sudo[96211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843
Sep 23 00:20:14 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:14 devstack sudo[96213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:14 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:15 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.547s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Deleted volume successfully.
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c807b591-2f58-4626-baf2-3cca9b7e9ca3 tempest-ServersNegativeTestJSON-2133608649 None] Lock "cinder-06b40894-a68d-46bf-a1da-461840888cd1-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:15 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" returned: 0 in 1.433s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22b336e8-0e33-4d5e-93fd-7354dc5bbe96_80xy9ybxdevstack@QuobyteHD, size 0.00 MB, duration 1.43 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:20:15 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:20:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:16 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1G
Sep 23 00:20:16 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:17 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 1G" returned: 0 in 1.164s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Downloaded image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 ((None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}])) to volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Temporary image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 for user 6aa5e0bb2736470bb0908cc73cd62441 is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Marking volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Copying metadata from image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 to ed5c285d-73b6-4caf-9a37-d84c8fbbd843. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Creating volume glance metadata for volume ed5c285d-73b6-4caf-9a37-d84c8fbbd843 backed by image 22b336e8-0e33-4d5e-93fd-7354dc5bbe96 with: {'image_id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3fa98f19d68d67723dbdbdd2f7053b27', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc13bc14-1513-4a6e-84b2-7fb161c3e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843', 'volume_size': 1, 'image_id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fa98f19d68d67723dbdbdd2f7053b27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a695f469f9ea49d69ae20af27b14d059', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57b5a84866dc938a7c07407553d5f083c67c9f60b22ca70beb5d07c0875f30c7022945b7028a2c5719e97dfded02a2aaa0b9e7405e063fc21ba29f799f41693f', 'id': '22b336e8-0e33-4d5e-93fd-7354dc5bbe96', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22b336e8-0e33-4d5e-93fd-7354dc5bbe96/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea1dbb60>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb00fbe-d583-4498-84ba-b2f797572ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Volume volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 (ed5c285d-73b6-4caf-9a37-d84c8fbbd843): created successfully
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb00fbe-d583-4498-84ba-b2f797572ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Flow 'volume_create_manager' (c1db0e6f-d059-452a-bf82-454cbbc055b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-58d84f40-e4fc-4029-9577-19ddd221e84a tempest-VolumeImageDependencyTests-1678651736 None] Created volume successfully.
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Acquiring lock "cinder-ed5c285d-73b6-4caf-9a37-d84c8fbbd843-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "cinder-ed5c285d-73b6-4caf-9a37-d84c8fbbd843-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Acquiring lock "cinder-quobyte-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "cinder-quobyte-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[04035753-0f9f-4449-89b3-e2d139cef0e2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:19 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843
Sep 23 00:20:19 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:19 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" returned: 0 in 1.085s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:19 devstack sudo[96275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843
Sep 23 00:20:19 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:20 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "cinder-quobyte-ed5c285d-73b6-4caf-9a37-d84c8fbbd843" released by "delete_volume" :: held 1.701s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Created reservations ['883b8b10-1cf9-4c2e-858c-0e6fdc8ec1c7', '8f5fbd08-0bc8-4bed-961f-654ad8fb49f0', '7e5842cd-1363-48ad-bf25-df1498e7d984', 'dbad06af-8ae1-4462-bc6d-a02e274ec3e2'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:20 devstack sudo[96278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:20 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:21 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.624s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:21 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Deleted volume successfully.
Sep 23 00:20:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2b7888ac-8d2d-43a8-ac57-6c6c47519be3 tempest-VolumeImageDependencyTests-1678651736 None] Lock "cinder-ed5c285d-73b6-4caf-9a37-d84c8fbbd843-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:22 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img" returned: 0 in 9.599s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5563b6-51df-498f-8d14-c504ae8cd271]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:22 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:20:22 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:23 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192, size 1024.00 MB, duration 9.60 sec, destination /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:20:23 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Converted 1024.00 MB image at 106.67 MB/s
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] 3f2ddf6e-81fa-4231-9e65-4c48567f1915 was raw, converting to qcow2 {{(pid=86631) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e07ed2-e2ba-4ab2-8393-b2f572d62cb7]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:23 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img
Sep 23 00:20:23 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:23 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img" returned: 0 in 0.471s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:24 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img
Sep 23 00:20:24 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:24 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img" returned: 1 in 0.492s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:24 devstack sudo[96296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq
Sep 23 00:20:24 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:24 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq" returned: 0 in 0.432s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Image conversion details: src /opt/stack/data/cinder/conversion/fbc6a781-ed08-489b-a73a-583630d70192.temp_image.3f2ddf6e-81fa-4231-9e65-4c48567f1915dk0t1cvj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:20:24 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ca1db-945f-4f8c-b0ab-f3e6fc103da3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:25 devstack sudo[96301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq
Sep 23 00:20:25 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:25 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_79lvj_hq" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.657s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Uploaded volume to glance image-id: 3f2ddf6e-81fa-4231-9e65-4c48567f1915. {{(pid=86631) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.301s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0f9c37f2-2ed1-4ade-904c-a1ff8312e920 tempest-VolumesActionsTest-1385206314 None] Copy volume to image completed successfully.
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Creating offline snapshot 248674c7-4440-484c-8f18-2099d03c089b of volume da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2679369d-1c5f-48ad-b7d4-5a3a5a9b0cee]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:27 devstack sudo[96307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1
Sep 23 00:20:27 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:28 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1" returned: 0 in 0.716s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:28 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b 1G
Sep 23 00:20:28 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Acquiring lock "cinder-quobyte-fbc6a781-ed08-489b-a73a-583630d70192" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "cinder-quobyte-fbc6a781-ed08-489b-a73a-583630d70192" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff9a17-b990-406c-bee5-d874ae0d73bf]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:29 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b 1G" returned: 0 in 0.836s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da12a130-5ccd-4a92-a328-c294df74d2e1 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:29 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da12a130-5ccd-4a92-a328-c294df74d2e1 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b
Sep 23 00:20:29 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:29 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:20:29 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:29 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da12a130-5ccd-4a92-a328-c294df74d2e1 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b" returned: 0 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:29 devstack sudo[96329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b
Sep 23 00:20:29 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:29 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.674s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:29 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192
Sep 23 00:20:29 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:30 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b" returned: 0 in 0.503s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:30 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-fbc6a781-ed08-489b-a73a-583630d70192" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:30 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info
Sep 23 00:20:30 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "cinder-quobyte-fbc6a781-ed08-489b-a73a-583630d70192" released by "delete_volume" :: held 1.219s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Created reservations ['0788b02a-a040-429e-b64d-d755a511fcb6', '1786216b-b421-401c-be0d-1cb07f060e30', '93923a6d-e80a-499a-b47b-d3b84ba16fd9', 'd7bf65a7-5c34-4659-844d-b1967621d027'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:30 devstack sudo[96339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:30 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:30 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info" returned: 0 in 0.461s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:30 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:20:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:30 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info
Sep 23 00:20:30 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:31 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.356s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:31 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Deleted volume successfully.
Sep 23 00:20:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e339d294-d5be-4ed5-b79e-49c50f37954c tempest-VolumesActionsTest-1385206314 None] Lock "cinder-fbc6a781-ed08-489b-a73a-583630d70192-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:31 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.info" returned: 0 in 0.368s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0c18280c-65f1-4c13-9caa-1c978c410525 tempest-GroupSnapshotsTest-1512656541 None] group_snapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: created successfully
Sep 23 00:20:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] group_snapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: deleting
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] group_snapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: deleting {{(pid=86631) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-248674c7-4440-484c-8f18-2099d03c089b" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-248674c7-4440-484c-8f18-2099d03c089b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Deleting offline snapshot 248674c7-4440-484c-8f18-2099d03c089b of volume da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] snapshot_file for this snap is: volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e355b444-33f8-4506-b279-85e6c182cccf]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:32 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b
Sep 23 00:20:32 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:33 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b" returned: 0 in 0.737s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da12a130-5ccd-4a92-a328-c294df74d2e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd381d-f8ec-4af9-a2d2-7a87dcb57585]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:33 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1
Sep 23 00:20:33 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:33 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1" returned: 0 in 0.687s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:33 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b
Sep 23 00:20:33 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:34 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:34 devstack sudo[96364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b
Sep 23 00:20:34 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:34 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1.248674c7-4440-484c-8f18-2099d03c089b" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-248674c7-4440-484c-8f18-2099d03c089b" released by "_delete_snapshot" :: held 2.556s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" released by "delete_snapshot" :: held 2.601s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:34 devstack cinder-volume[86631]: WARNING cinder.quota [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-404982383 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-404982383, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:34 devstack cinder-volume[86631]: WARNING cinder.quota [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-404982383 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-404982383, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['4753ae69-8e1a-4a75-a20b-f14fa24d9184', 'db24c35e-f7bc-42e9-8116-2866c4d0dbbe', '2f9209a2-99e2-45ef-b763-f6b02a17a3ca', 'e83b7f84-5393-46db-80d6-36140483f608'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0b39e6fc-344f-4a8d-8e24-1af74baf404a tempest-GroupSnapshotsTest-1512656541 None] group_snapshot 3a924e4e-eb5f-47e7-b621-adae69cb3887: deleted successfully
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1c5d5-2a94-4a10-b668-b40ae518d134]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:36 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1
Sep 23 00:20:36 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:36 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1" returned: 0 in 0.527s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:36 devstack sudo[96372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1
Sep 23 00:20:36 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:37 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-da12a130-5ccd-4a92-a328-c294df74d2e1" returned: 0 in 0.396s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Lock "cinder-quobyte-da12a130-5ccd-4a92-a328-c294df74d2e1" released by "delete_volume" :: held 1.019s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['a5a27da7-275c-43d3-ac3f-1edbed6583fd'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:37 devstack cinder-volume[86631]: WARNING cinder.quota [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-404982383 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-404982383, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Created reservations ['6790f095-b994-46b6-8ae8-742d9b145e71', '79b57a17-b3b4-4e7c-8b42-3d2a95fdf0af', '3e284ef3-1261-4cbc-a463-d4adf096bc10', 'e8f18b8b-0c1f-44b4-9b7d-e51746921910'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:37 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:37 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:38 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:38 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:38 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-47d1cde8-c49b-47aa-b9d9-a2ee7bd430e1 tempest-GroupSnapshotsTest-1512656541 None] Delete group completed successfully.
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Flow 'volume_create_manager' (abc60485-054b-4dc6-8942-b8e6c495d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b85ffe-5647-45a6-85fa-f51f3b8030c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b85ffe-5647-45a6-85fa-f51f3b8030c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1873649145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91829b74-c3d7-44ac-a57a-878c3f83ca0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a16f958b14fbca979cbd5ed774233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:44Z,use_quota=True,user_id='95bd38b6ec444c20a51ecd4f2ab2aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd34d33-b5ad-4afd-a90d-dcd26c231362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd34d33-b5ad-4afd-a90d-dcd26c231362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01800103-e9d4-492a-85a4-0430d11ec83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01800103-e9d4-492a-85a4-0430d11ec83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'volume_name': 'volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41528498-5aef-4d73-8f6c-882c5359e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41528498-5aef-4d73-8f6c-882c5359e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3658b0dc-95ab-4a21-8b2c-f54826417f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Volume 91829b74-c3d7-44ac-a57a-878c3f83ca0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'volume_size': 1}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1873649145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91829b74-c3d7-44ac-a57a-878c3f83ca0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a16f958b14fbca979cbd5ed774233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:44Z,use_quota=True,user_id='95bd38b6ec444c20a51ecd4f2ab2aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Creating volume 91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:20:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:20:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:44 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f 1073741824
Sep 23 00:20:44 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:45 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f 1073741824" returned: 0 in 0.765s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:45 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:20:45 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:45 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3658b0dc-95ab-4a21-8b2c-f54826417f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fa0b55-9012-47bf-8599-91cc42333034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Volume volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f (91829b74-c3d7-44ac-a57a-878c3f83ca0f): created successfully
Sep 23 00:20:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fa0b55-9012-47bf-8599-91cc42333034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:46 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Flow 'volume_create_manager' (abc60485-054b-4dc6-8942-b8e6c495d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2a57a237-5ce5-4302-8239-e87e57a37822 tempest-VolumesCloneTest-305742840 None] Created volume successfully.
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Flow 'volume_create_manager' (b5548645-c345-4879-876f-2fcccac81797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd99ca-a5a7-474a-b209-acc6508b26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bd99ca-a5a7-474a-b209-acc6508b26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1085335014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8202b30b-037a-48bd-bf81-c52bcdb1cfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302a16f958b14fbca979cbd5ed774233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=91829b74-c3d7-44ac-a57a-878c3f83ca0f,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:48Z,use_quota=True,user_id='95bd38b6ec444c20a51ecd4f2ab2aa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4cb11e-9324-4c95-8f6e-93131609b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4cb11e-9324-4c95-8f6e-93131609b617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc2ec9-f041-4693-8121-54a52b2365b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc2ec9-f041-4693-8121-54a52b2365b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8202b30b-037a-48bd-bf81-c52bcdb1cfdc', 'volume_name': 'volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc', 'volume_size': 2, 'source_volid': '91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'source_volstatus': 'available'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bc61f0-867e-4392-a728-e4fad677f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bc61f0-867e-4392-a728-e4fad677f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58d124-dae8-4f58-bc2c-7dd842cec4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:20:47 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Volume 8202b30b-037a-48bd-bf81-c52bcdb1cfdc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc', 'volume_size': 2, 'source_volid': '91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'source_volstatus': 'available'}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:47 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Cloning volume 91829b74-c3d7-44ac-a57a-878c3f83ca0f to volume 8202b30b-037a-48bd-bf81-c52bcdb1cfdc
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Creating offline snapshot 5c3ac895-b683-4840-a9f6-0a6c89979af8 of volume 91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744fddf-81b3-4fd3-9659-e91fd56f09a9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:48 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:20:48 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:48 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.513s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:48 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 1G
Sep 23 00:20:48 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:49 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 1G" returned: 0 in 0.656s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:49 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:20:49 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:49 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.377s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:49 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 is being set with open permissions: ugo+rw
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:49 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:20:49 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:49 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.376s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:49 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info
Sep 23 00:20:49 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:50 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:50 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info is being set with open permissions: ugo+rw
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:50 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info
Sep 23 00:20:50 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:50 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.info" returned: 0 in 0.288s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] snapshot: 5c3ac895-b683-4840-a9f6-0a6c89979af8, volume: 8202b30b-037a-48bd-bf81-c52bcdb1cfdc,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf4f99-8828-4161-96a3-20102fe61f65]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:50 devstack sudo[96461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:20:50 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:51 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef9fca3-7bf7-4da0-ae12-f5c5b58e9b7a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:51 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:20:51 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:51 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.552s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:20:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:52 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc
Sep 23 00:20:52 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:20:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:20:57 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:20:57 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:20:57 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Sep 23 00:20:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.730s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:20:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:20:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:20:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:20:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:20:59 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=62,cinder:SELECT=63,cinder:DELETE=2,cinder:INSERT=21 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:20:59 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=51,cinder:UPDATE=68,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:02 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" returned: 0 in 10.443s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f, size 1024.00 MB, duration 10.44 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:21:02 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Converted 1024.00 MB image at 98.04 MB/s
Sep 23 00:21:02 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc is being set with open permissions: ugo+rw
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:02 devstack sudo[96490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc
Sep 23 00:21:02 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:02 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" returned: 0 in 0.331s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" released by "_copy_volume_from_snapshot" :: held 12.116s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-quobyte-5c3ac895-b683-4840-a9f6-0a6c89979af8" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-5c3ac895-b683-4840-a9f6-0a6c89979af8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Deleting offline snapshot 5c3ac895-b683-4840-a9f6-0a6c89979af8 of volume 91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] snapshot_file for this snap is: volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2722e896-8054-43d9-b129-ca9edcb686f5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:02 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:21:02 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:03 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.466s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:21:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f50f6-8d9f-4e1b-822e-bb2049db9fef]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:03 devstack sudo[96501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:21:03 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:04 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.860s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:04 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:21:04 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:04 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.620s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:04 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8
Sep 23 00:21:04 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:05 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f.5c3ac895-b683-4840-a9f6-0a6c89979af8" returned: 0 in 0.397s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-5c3ac895-b683-4840-a9f6-0a6c89979af8" released by "_delete_snapshot" :: held 2.504s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.498s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58d124-dae8-4f58-bc2c-7dd842cec4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc', 'volume_size': 2, 'source_volid': '91829b74-c3d7-44ac-a57a-878c3f83ca0f', 'source_volstatus': 'available'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3859e36-cd3a-4a2b-b6e2-85292abb1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Volume volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc (8202b30b-037a-48bd-bf81-c52bcdb1cfdc): created successfully
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3859e36-cd3a-4a2b-b6e2-85292abb1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Flow 'volume_create_manager' (b5548645-c345-4879-876f-2fcccac81797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-71d2e631-7f1f-48ee-b14b-f7b6f593f5e9 tempest-VolumesCloneTest-305742840 None] Created volume successfully.
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-8202b30b-037a-48bd-bf81-c52bcdb1cfdc-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "cinder-8202b30b-037a-48bd-bf81-c52bcdb1cfdc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a522a-9f06-4388-8c52-c1704c13a28d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:07 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc
Sep 23 00:21:07 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:07 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" returned: 0 in 0.578s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:07 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc
Sep 23 00:21:07 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:07 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-8202b30b-037a-48bd-bf81-c52bcdb1cfdc" released by "delete_volume" :: held 1.073s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Created reservations ['9d7ed361-e78a-4618-ab16-7f702e1ca448', '05a6bb0b-5dfc-4c96-93bb-2cf6875c9eb7', '95ed8c78-ef2f-48e5-b1e4-14f9656ac0dc', 'cd1c0294-c0bf-4c24-9f4a-80ac02d9a43c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:08 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:08 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:08 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.383s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Deleted volume successfully.
Sep 23 00:21:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-37217fa9-a365-47b8-8314-c53014cc7145 tempest-VolumesCloneTest-305742840 None] Lock "cinder-8202b30b-037a-48bd-bf81-c52bcdb1cfdc-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-91829b74-c3d7-44ac-a57a-878c3f83ca0f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "cinder-91829b74-c3d7-44ac-a57a-878c3f83ca0f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Acquiring lock "cinder-quobyte-91829b74-c3d7-44ac-a57a-878c3f83ca0f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-91829b74-c3d7-44ac-a57a-878c3f83ca0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28acbff-db2b-4d05-b418-ef3012c0385f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:09 devstack sudo[96542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:21:09 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:10 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.542s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:10 devstack sudo[96547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f
Sep 23 00:21:10 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:10 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-91829b74-c3d7-44ac-a57a-878c3f83ca0f" returned: 0 in 0.698s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "cinder-quobyte-91829b74-c3d7-44ac-a57a-878c3f83ca0f" released by "delete_volume" :: held 1.390s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:10 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Created reservations ['386c338c-7508-4592-9c2d-ae891744b27a', 'eda2c8eb-1894-4d48-b66d-9f15d172c967', '5a1b6c92-2481-4658-a891-c5e5f3036244', '2d87f6cd-8e05-4dee-8520-b7fa9f6dcf4e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:11 devstack sudo[96610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:11 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:12 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.861s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:12 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Deleted volume successfully.
Sep 23 00:21:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-122571dd-091c-43d2-aeb3-4a824336d4f4 tempest-VolumesCloneTest-305742840 None] Lock "cinder-91829b74-c3d7-44ac-a57a-878c3f83ca0f-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Flow 'volume_create_manager' (300e479e-bc6d-46ac-aa82-82c843ac0c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09acaf75-8208-4cdb-b7e4-0ccb51732ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09acaf75-8208-4cdb-b7e4-0ccb51732ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-913051890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9587db5d-3328-47ef-97b3-c04550a2aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4c269598bb4c10bb3c8a515c55266a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:19Z,use_quota=True,user_id='7a92db64a70a4960888c7441b1b7bee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc04055-3a29-4581-b1c0-e6a0750d5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc04055-3a29-4581-b1c0-e6a0750d5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302960af-0490-4a11-9d52-fe9012134150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302960af-0490-4a11-9d52-fe9012134150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9587db5d-3328-47ef-97b3-c04550a2aa41', 'volume_name': 'volume-9587db5d-3328-47ef-97b3-c04550a2aa41', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843a49a8-2949-4a2e-8cad-ebaa6116bd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843a49a8-2949-4a2e-8cad-ebaa6116bd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eed79c2-2747-471d-b568-f8fa38e06c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Volume 9587db5d-3328-47ef-97b3-c04550a2aa41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9587db5d-3328-47ef-97b3-c04550a2aa41', 'volume_size': 1}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-913051890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9587db5d-3328-47ef-97b3-c04550a2aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4c269598bb4c10bb3c8a515c55266a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:19Z,use_quota=True,user_id='7a92db64a70a4960888c7441b1b7bee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Creating volume 9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:19 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 1073741824
Sep 23 00:21:19 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:19 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 1073741824" returned: 0 in 0.592s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:19 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41
Sep 23 00:21:19 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:20 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41" returned: 0 in 0.420s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eed79c2-2747-471d-b568-f8fa38e06c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9587db5d-3328-47ef-97b3-c04550a2aa41', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67739d6b-f7fd-4aea-ab47-8d7cddf8a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Volume volume-9587db5d-3328-47ef-97b3-c04550a2aa41 (9587db5d-3328-47ef-97b3-c04550a2aa41): created successfully
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67739d6b-f7fd-4aea-ab47-8d7cddf8a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Flow 'volume_create_manager' (300e479e-bc6d-46ac-aa82-82c843ac0c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4bb63356-4cb3-4693-9750-97849b360e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Created volume successfully.
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Flow 'volume_create_manager' (157bb658-2dba-4de3-adce-aed5956f21ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3fdca0-ede8-4cb7-8052-26fdfa7e81f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3fdca0-ede8-4cb7-8052-26fdfa7e81f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-225613788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6b6738-29d1-4699-ba25-a2400a94b3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85058c7898764e7dadc1717895de0b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:20Z,use_quota=True,user_id='5e2b41e0268f413d8ef07ebb4ae5dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0369d2-83c8-4cd7-ad90-7260e9f03b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0369d2-83c8-4cd7-ad90-7260e9f03b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aab1666-a7c5-4772-9b83-ad4a375521ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aab1666-a7c5-4772-9b83-ad4a375521ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6b6738-29d1-4699-ba25-a2400a94b3ba', 'volume_name': 'volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba', 'volume_size': 2}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7789945-b70a-4692-9afc-45b110cdf0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7789945-b70a-4692-9afc-45b110cdf0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68375dee-662f-42df-bcef-91844b9a1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Volume 0e6b6738-29d1-4699-ba25-a2400a94b3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba', 'volume_size': 2}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-225613788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6b6738-29d1-4699-ba25-a2400a94b3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85058c7898764e7dadc1717895de0b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:20Z,use_quota=True,user_id='5e2b41e0268f413d8ef07ebb4ae5dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Creating volume 0e6b6738-29d1-4699-ba25-a2400a94b3ba {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:20 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba 2147483648 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:20 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba 2147483648
Sep 23 00:21:20 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:21 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba 2147483648" returned: 0 in 0.670s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:21 devstack sudo[96650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba
Sep 23 00:21:21 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:21 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba" returned: 0 in 0.464s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68375dee-662f-42df-bcef-91844b9a1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba', 'volume_size': 2}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316f590a-6ff4-4006-bf0d-5e45ac32d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Creating offline snapshot e3221f80-0c31-4bb2-8ba2-9935054a0aea of volume 9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:21:21 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Volume volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba (0e6b6738-29d1-4699-ba25-a2400a94b3ba): created successfully
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316f590a-6ff4-4006-bf0d-5e45ac32d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Flow 'volume_create_manager' (157bb658-2dba-4de3-adce-aed5956f21ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c155f45-d543-4284-829b-59b39f917e5b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5ce6faf7-f356-416a-8843-509d1ebac375 tempest-VolumesCloneNegativeTest-2027087132 None] Created volume successfully.
Sep 23 00:21:21 devstack sudo[96653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41
Sep 23 00:21:21 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:22 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41" returned: 0 in 0.558s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:22 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea 1G
Sep 23 00:21:22 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Acquiring lock "cinder-0e6b6738-29d1-4699-ba25-a2400a94b3ba-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "cinder-0e6b6738-29d1-4699-ba25-a2400a94b3ba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Acquiring lock "cinder-quobyte-0e6b6738-29d1-4699-ba25-a2400a94b3ba" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "cinder-quobyte-0e6b6738-29d1-4699-ba25-a2400a94b3ba" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0928d-aa62-43e2-ab1f-51c563bafa26]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:23 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea 1G" returned: 0 in 0.619s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9587db5d-3328-47ef-97b3-c04550a2aa41 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:23 devstack sudo[96664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9587db5d-3328-47ef-97b3-c04550a2aa41 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea
Sep 23 00:21:23 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:23 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba
Sep 23 00:21:23 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:23 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:23 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9587db5d-3328-47ef-97b3-c04550a2aa41 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea is being set with open permissions: ugo+rw
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:23 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba
Sep 23 00:21:23 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:23 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea
Sep 23 00:21:23 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:23 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:23 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0e6b6738-29d1-4699-ba25-a2400a94b3ba" returned: 0 in 0.331s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "cinder-quobyte-0e6b6738-29d1-4699-ba25-a2400a94b3ba" released by "delete_volume" :: held 0.859s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:23 devstack sudo[96679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info
Sep 23 00:21:23 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:23 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Created reservations ['b89545f3-d736-4fba-af9f-83971c4daa40', 'bda8c2e2-0ad0-482e-befb-65460c4d306f', '1668ee67-24a0-4c4b-827c-6e141afe07dc', '43a347c7-3ee8-4c1f-9804-c1903c9cd146'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:24 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:24 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:24 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info" returned: 0 in 0.381s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:24 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info is being set with open permissions: ugo+rw
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:24 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info
Sep 23 00:21:24 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:24 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.340s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Deleted volume successfully.
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1008d0ec-9dc5-411c-a593-1d9b7a5e2be2 tempest-VolumesCloneNegativeTest-2027087132 None] Lock "cinder-0e6b6738-29d1-4699-ba25-a2400a94b3ba-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:24 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.info" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-602d9591-32d2-4396-801a-dc11f3b19800 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Create snapshot completed successfully
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "cinder-e3221f80-0c31-4bb2-8ba2-9935054a0aea-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-e3221f80-0c31-4bb2-8ba2-9935054a0aea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "cinder-quobyte-e3221f80-0c31-4bb2-8ba2-9935054a0aea" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-e3221f80-0c31-4bb2-8ba2-9935054a0aea" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Deleting offline snapshot e3221f80-0c31-4bb2-8ba2-9935054a0aea of volume 9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] snapshot_file for this snap is: volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f161310-2bab-4ad9-a3a7-edec07e86bcd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:25 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea
Sep 23 00:21:25 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:26 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea" returned: 0 in 0.572s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9587db5d-3328-47ef-97b3-c04550a2aa41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:21:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84cf87-359e-43f6-83ce-4a5d198d0c88]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:26 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41
Sep 23 00:21:26 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:26 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41" returned: 0 in 0.674s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:27 devstack sudo[96699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea
Sep 23 00:21:27 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:27 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea" returned: 0 in 0.632s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:27 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea
Sep 23 00:21:27 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:28 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41.e3221f80-0c31-4bb2-8ba2-9935054a0aea" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-e3221f80-0c31-4bb2-8ba2-9935054a0aea" released by "_delete_snapshot" :: held 2.463s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" released by "delete_snapshot" :: held 2.503s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Created reservations ['404e063a-85a1-4726-8ed6-c9fb7cfc5fbd', 'dc03e10f-aa6c-4f61-a0a8-e790d9f0cfed', 'e6fe9f42-b194-4d93-b8be-d6eaeb0b6eda', '5a436690-8b51-4eda-827b-4dda917d31dd'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Delete snapshot completed successfully.
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c9f9e95-8912-4389-96d0-4f6bc41de55d tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-e3221f80-0c31-4bb2-8ba2-9935054a0aea-delete_snapshot" released by "delete_snapshot" :: held 2.707s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "cinder-9587db5d-3328-47ef-97b3-c04550a2aa41-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-9587db5d-3328-47ef-97b3-c04550a2aa41-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" acquired by "delete_volume" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22ab71-b088-4569-a54b-7324e3663e0b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:29 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41
Sep 23 00:21:29 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:29 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41" returned: 0 in 0.455s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:29 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41
Sep 23 00:21:29 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:29 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9587db5d-3328-47ef-97b3-c04550a2aa41" returned: 0 in 0.376s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-quobyte-9587db5d-3328-47ef-97b3-c04550a2aa41" released by "delete_volume" :: held 0.917s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Created reservations ['60d9a500-2efd-4445-9868-13fb163fa0b9', 'b02336b0-b5ae-4adc-8a0c-e8b107ccbb1d', '4c2ff81f-2c95-4cba-8b28-83f75a71a14f', '03c98d7e-5395-4654-a5fe-640ea16a5560'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:30 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:30 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:30 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.311s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Deleted volume successfully.
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-13b5a043-955d-4309-86cb-8fda92584e52 tempest-VolumeSnapshotQuotasNegativeTestJSON-898562404 None] Lock "cinder-9587db5d-3328-47ef-97b3-c04550a2aa41-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (82078b7d-83a9-42e8-9e6e-53f6433ce1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95b762d-6b6d-456c-97a2-97266e081519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95b762d-6b6d-456c-97a2-97266e081519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117135774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:31Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75e59dd-26d0-4038-921d-1de6128f2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75e59dd-26d0-4038-921d-1de6128f2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577c295-bee8-4ba4-a6c1-2360893323de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3577c295-bee8-4ba4-a6c1-2360893323de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb', 'volume_name': 'volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1263a44d-442e-4b79-ac96-c0a2a9279419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1263a44d-442e-4b79-ac96-c0a2a9279419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e29ff22-4d52-440e-99bf-9e9a985894cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Volume 42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb', 'volume_size': 1}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117135774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:31Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Creating volume 42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:30 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:30 devstack sudo[96733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb 1073741824
Sep 23 00:21:30 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:31 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb 1073741824" returned: 0 in 0.577s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:31 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb
Sep 23 00:21:31 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:31 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e29ff22-4d52-440e-99bf-9e9a985894cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f191efd-eb6f-4d08-8fd9-4ebb1e2896e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:31 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Volume volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb (42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb): created successfully
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f191efd-eb6f-4d08-8fd9-4ebb1e2896e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (82078b7d-83a9-42e8-9e6e-53f6433ce1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5511830b-b679-470f-a84c-8b68c4f274b8 tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (3c078497-208c-4f86-a064-db05781e8b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa2d972-31c7-45a9-98d6-eb60f04dc03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa2d972-31c7-45a9-98d6-eb60f04dc03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40409499',display_name='tempest-VolumesGetTest-Volume-1579134811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01b1f27-0e97-4160-8d45-f7a5d1ccec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a7461-ca9a-49b7-9cea-bddd4023e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a7461-ca9a-49b7-9cea-bddd4023e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d82ca1-fb17-44a0-8ce9-3beabbb3aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d82ca1-fb17-44a0-8ce9-3beabbb3aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01b1f27-0e97-4160-8d45-f7a5d1ccec60', 'volume_name': 'volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1271da-6c3e-4993-9ff4-2b70985452a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1271da-6c3e-4993-9ff4-2b70985452a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78276475-efe6-469b-9da7-24b78b8d17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Volume e01b1f27-0e97-4160-8d45-f7a5d1ccec60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60', 'volume_size': 1}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40409499',display_name='tempest-VolumesGetTest-Volume-1579134811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01b1f27-0e97-4160-8d45-f7a5d1ccec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Creating volume e01b1f27-0e97-4160-8d45-f7a5d1ccec60 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:34 devstack sudo[96743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 1073741824
Sep 23 00:21:34 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:34 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 1073741824" returned: 0 in 0.621s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:34 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60
Sep 23 00:21:34 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:35 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" returned: 0 in 0.462s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78276475-efe6-469b-9da7-24b78b8d17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b686482d-e7fa-4eee-ad4e-9d307b4e09f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Volume volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 (e01b1f27-0e97-4160-8d45-f7a5d1ccec60): created successfully
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b686482d-e7fa-4eee-ad4e-9d307b4e09f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (3c078497-208c-4f86-a064-db05781e8b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5507d6d4-6af5-403e-a64e-b27d0abcd45a tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-e01b1f27-0e97-4160-8d45-f7a5d1ccec60-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "cinder-e01b1f27-0e97-4160-8d45-f7a5d1ccec60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" acquired by "delete_volume" :: waited 0.015s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab68c395-4b71-4e51-b955-0032f083952a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:36 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60
Sep 23 00:21:36 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:37 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" returned: 0 in 0.572s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:37 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60
Sep 23 00:21:37 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:37 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" returned: 0 in 0.393s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e01b1f27-0e97-4160-8d45-f7a5d1ccec60" released by "delete_volume" :: held 1.042s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Created reservations ['d7405bdd-9583-44cb-a710-1606d63d15db', '9a53d9dd-3131-4973-a4af-9da524eebe30', '7839f6d4-76af-41ae-843f-9fa30ed7e447', '07f1db55-42cf-41f2-a7f3-a8be56803878'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:37 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:37 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:38 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (c86f2f39-486f-4f56-a20c-fa80e1769122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff6109-861c-4e93-9a7d-4aa714205765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.404s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff6109-861c-4e93-9a7d-4aa714205765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-552588222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd7840-5ff7-4025-b4a6-0b981b0dd105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:38Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669443e5-4d46-4128-b15d-5f0cad0521ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669443e5-4d46-4128-b15d-5f0cad0521ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccdabe6-9fda-48de-8a54-13622381ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccdabe6-9fda-48de-8a54-13622381ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbd7840-5ff7-4025-b4a6-0b981b0dd105', 'volume_name': 'volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd68ac7-07d4-4056-a4d2-0d731e69bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd68ac7-07d4-4056-a4d2-0d731e69bd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d11e81-e31a-45a6-9927-a32ef623da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Volume 2fbd7840-5ff7-4025-b4a6-0b981b0dd105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105', 'volume_size': 1}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-552588222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd7840-5ff7-4025-b4a6-0b981b0dd105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:38Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Creating volume 2fbd7840-5ff7-4025-b4a6-0b981b0dd105 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:38 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:38 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:21:38 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 1073741824
Sep 23 00:21:38 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05582cc9-0302-471e-9df7-dc02078aceff tempest-VolumesGetTest-810535255 None] Lock "cinder-e01b1f27-0e97-4160-8d45-f7a5d1ccec60-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "cinder-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:39 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 1073741824" returned: 0 in 0.749s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8710c11e-2313-499b-87e8-8558c5dc295f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:39 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105
Sep 23 00:21:39 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:39 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb
Sep 23 00:21:39 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:39 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" returned: 0 in 0.365s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d11e81-e31a-45a6-9927-a32ef623da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e2faf7-f5f7-44d9-80cb-165c5d61b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:39 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Volume volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 (2fbd7840-5ff7-4025-b4a6-0b981b0dd105): created successfully
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e2faf7-f5f7-44d9-80cb-165c5d61b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (c86f2f39-486f-4f56-a20c-fa80e1769122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-930ed883-2b97-405f-8426-09e0016558a0 tempest-AttachVolumeNegativeTest-768989548 None] Created volume successfully.
Sep 23 00:21:39 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" returned: 0 in 0.655s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:39 devstack sudo[96820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb
Sep 23 00:21:39 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:40 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" returned: 0 in 0.352s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb" released by "delete_volume" :: held 1.085s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Created reservations ['622abe32-6604-4747-bca1-47143585a188', '95d2d64e-1406-4845-935a-6b252d4ee015', '96574a48-9b02-4bdf-9cd9-5ca92b75c22e', '1d1db0ed-f6a1-473a-9e40-34d31967bb69'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:40 devstack sudo[96825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:40 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:40 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:21:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3fa8bc0f-f80a-4048-b615-3eb81478344b tempest-VolumesGetTest-810535255 None] Lock "cinder-42fe9bd2-ab0a-4bbe-9e67-49ea9af6c1fb-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:21:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-6b17e5ab-db03-4d5d-8bb6-49e5dbba7c95 req-f5c67ac3-2873-4c41-9492-74b1db9db2bd tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-6b17e5ab-db03-4d5d-8bb6-49e5dbba7c95 req-f5c67ac3-2873-4c41-9492-74b1db9db2bd tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-6b17e5ab-db03-4d5d-8bb6-49e5dbba7c95 req-f5c67ac3-2873-4c41-9492-74b1db9db2bd tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-6b17e5ab-db03-4d5d-8bb6-49e5dbba7c95 req-f5c67ac3-2873-4c41-9492-74b1db9db2bd tempest-AttachVolumeNegativeTest-768989548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2af2fb71-2242-4018-9bf9-2272f7af759f', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:21:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-6b17e5ab-db03-4d5d-8bb6-49e5dbba7c95 req-f5c67ac3-2873-4c41-9492-74b1db9db2bd tempest-AttachVolumeNegativeTest-768989548 None] attachment_update completed successfully.
Sep 23 00:21:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (099035c1-9e04-4d5d-8a2d-588dde6cb032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb42b7d1-d6df-4aa1-99c8-9a9afa70a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb42b7d1-d6df-4aa1-99c8-9a9afa70a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1827128022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c104f0a4-8d6a-465e-bab7-33e08dd69942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:42Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b42b51-0f1d-4a7f-b426-d9bb822fcf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b42b51-0f1d-4a7f-b426-d9bb822fcf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f71fc-06b1-42ed-a009-04ee6b165aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f71fc-06b1-42ed-a009-04ee6b165aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c104f0a4-8d6a-465e-bab7-33e08dd69942', 'volume_name': 'volume-c104f0a4-8d6a-465e-bab7-33e08dd69942', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082b8c09-691b-401d-a7f1-8c60f6747639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082b8c09-691b-401d-a7f1-8c60f6747639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b7b237-d157-413b-8d53-2bd40c3f828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Volume c104f0a4-8d6a-465e-bab7-33e08dd69942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c104f0a4-8d6a-465e-bab7-33e08dd69942', 'volume_size': 1}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1827128022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c104f0a4-8d6a-465e-bab7-33e08dd69942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:42Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Creating volume c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:21:42 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:42 devstack sudo[96966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 1073741824
Sep 23 00:21:42 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:42 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 1073741824" returned: 0 in 0.778s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:43 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:21:43 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:43 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b7b237-d157-413b-8d53-2bd40c3f828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c104f0a4-8d6a-465e-bab7-33e08dd69942', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d659f-6d50-4b1e-9b4a-ece95c0f4d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:43 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Volume volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 (c104f0a4-8d6a-465e-bab7-33e08dd69942): created successfully
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d659f-6d50-4b1e-9b4a-ece95c0f4d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (099035c1-9e04-4d5d-8a2d-588dde6cb032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e4c5321d-3e41-434e-8747-18a95a09f5b6 tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (ef5bc0f6-145a-4c86-8dfd-f91ba15831f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e41059-ccee-4c45-ab9d-51a7c19da06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e41059-ccee-4c45-ab9d-51a7c19da06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1016461222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5de507b-7e02-4976-9f03-fc8d6f3c8f0f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c104f0a4-8d6a-465e-bab7-33e08dd69942,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:45Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc5722-85eb-402a-88ad-8b0baadf220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc5722-85eb-402a-88ad-8b0baadf220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74af8aff-a030-4c7e-83ba-577d33eb0611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74af8aff-a030-4c7e-83ba-577d33eb0611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e5de507b-7e02-4976-9f03-fc8d6f3c8f0f', 'volume_name': 'volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f', 'volume_size': 1, 'source_volid': 'c104f0a4-8d6a-465e-bab7-33e08dd69942', 'source_volstatus': 'available'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47120de5-816e-4963-ba02-62e7dabfed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47120de5-816e-4963-ba02-62e7dabfed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaeb4af-4516-4115-9b02-7055f86e6366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:21:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Volume e5de507b-7e02-4976-9f03-fc8d6f3c8f0f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f', 'volume_size': 1, 'source_volid': 'c104f0a4-8d6a-465e-bab7-33e08dd69942', 'source_volstatus': 'available'}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:45 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Cloning volume c104f0a4-8d6a-465e-bab7-33e08dd69942 to volume e5de507b-7e02-4976-9f03-fc8d6f3c8f0f
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Creating offline snapshot e225c167-7c26-4a36-8f56-e23d0b7d75e6 of volume c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e8b72e-c996-4b89-a61b-5940142b96a4]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:45 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:21:45 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:45 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 0.639s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:45 devstack sudo[97267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 1G
Sep 23 00:21:45 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:46 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 1G" returned: 0 in 0.654s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:46 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:21:46 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:46 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.498s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:46 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 is being set with open permissions: ugo+rw
Sep 23 00:21:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:46 devstack sudo[97279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:21:46 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:47 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.353s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:47 devstack sudo[97282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info
Sep 23 00:21:47 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:47 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info" returned: 0 in 0.392s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:47 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info is being set with open permissions: ugo+rw
Sep 23 00:21:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:47 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info
Sep 23 00:21:47 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:48 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.info" returned: 0 in 0.409s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] snapshot: e225c167-7c26-4a36-8f56-e23d0b7d75e6, volume: e5de507b-7e02-4976-9f03-fc8d6f3c8f0f,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacab60b-1ed8-4a6e-9046-b1fc29919b2a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:48 devstack sudo[97292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:21:48 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:48 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c104f0a4-8d6a-465e-bab7-33e08dd69942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdeddf2-9412-4e28-bb8e-b7c911930874]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:21:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:49 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:21:49 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:49 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 0.675s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:21:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:21:49 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:21:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:49 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f
Sep 23 00:21:49 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:21:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:21:57 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:21:57 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=77,cinder:SELECT=65,cinder:DELETE=10,cinder:INSERT=18 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=82,cinder:INSERT=20,cinder:SELECT=61,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:21:57 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.820s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:21:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:22:00 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" returned: 0 in 11.025s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:00 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942, size 1024.00 MB, duration 11.03 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:22:00 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Converted 1024.00 MB image at 92.87 MB/s
Sep 23 00:22:00 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f is being set with open permissions: ugo+rw
Sep 23 00:22:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:00 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f
Sep 23 00:22:00 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:00 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" released by "_copy_volume_from_snapshot" :: held 12.812s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-e225c167-7c26-4a36-8f56-e23d0b7d75e6" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e225c167-7c26-4a36-8f56-e23d0b7d75e6" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Deleting offline snapshot e225c167-7c26-4a36-8f56-e23d0b7d75e6 of volume c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] snapshot_file for this snap is: volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda7c46-59f8-423c-9e9a-21823ca341ee]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:01 devstack sudo[97385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:22:01 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:01 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.536s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c104f0a4-8d6a-465e-bab7-33e08dd69942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9cf2ab-f6e4-4192-9e2f-30554db4322b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:22:02 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:02 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 1.136s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:02 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:22:02 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:03 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.798s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:03 devstack sudo[97427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6
Sep 23 00:22:03 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:04 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942.e225c167-7c26-4a36-8f56-e23d0b7d75e6" returned: 0 in 0.589s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e225c167-7c26-4a36-8f56-e23d0b7d75e6" released by "_delete_snapshot" :: held 3.256s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.320s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaeb4af-4516-4115-9b02-7055f86e6366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f', 'volume_size': 1, 'source_volid': 'c104f0a4-8d6a-465e-bab7-33e08dd69942', 'source_volstatus': 'available'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16c5dfa-de2f-42db-a984-629796e78fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:04 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Volume volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f (e5de507b-7e02-4976-9f03-fc8d6f3c8f0f): created successfully
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16c5dfa-de2f-42db-a984-629796e78fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (ef5bc0f6-145a-4c86-8dfd-f91ba15831f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:04 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-08fa6d5d-4c62-4cee-8051-987c7eba4ed7 tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (9dc12597-93e9-404e-911f-2c061d959393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0517e2-86b5-482f-a995-28558d5e1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0517e2-86b5-482f-a995-28558d5e1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691651950',display_name='tempest-VolumesGetTest-Volume-2068806796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70282e6-c802-4ae4-8773-7a25d7777c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e642c2-37b7-44a0-bf59-27c3dc307a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e642c2-37b7-44a0-bf59-27c3dc307a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d42fe4e-2b4a-44a1-8a0b-c18830052acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d42fe4e-2b4a-44a1-8a0b-c18830052acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70282e6-c802-4ae4-8773-7a25d7777c8b', 'volume_name': 'volume-a70282e6-c802-4ae4-8773-7a25d7777c8b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f235093-ecf4-4869-8ed8-400415ca6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f235093-ecf4-4869-8ed8-400415ca6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d375f1e-c6b6-4a60-a110-facde6cc6813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Volume a70282e6-c802-4ae4-8773-7a25d7777c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70282e6-c802-4ae4-8773-7a25d7777c8b', 'volume_size': 1}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691651950',display_name='tempest-VolumesGetTest-Volume-2068806796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70282e6-c802-4ae4-8773-7a25d7777c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Creating volume a70282e6-c802-4ae4-8773-7a25d7777c8b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:06 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b 1073741824
Sep 23 00:22:06 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:06 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b 1073741824" returned: 0 in 0.612s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:06 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b
Sep 23 00:22:06 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:07 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d375f1e-c6b6-4a60-a110-facde6cc6813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70282e6-c802-4ae4-8773-7a25d7777c8b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8da4151-32b7-4c8e-9432-22fc12e80f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Volume volume-a70282e6-c802-4ae4-8773-7a25d7777c8b (a70282e6-c802-4ae4-8773-7a25d7777c8b): created successfully
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8da4151-32b7-4c8e-9432-22fc12e80f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (9dc12597-93e9-404e-911f-2c061d959393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ff391170-cfc5-4070-8110-008a1bc1c1de tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-a70282e6-c802-4ae4-8773-7a25d7777c8b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "cinder-a70282e6-c802-4ae4-8773-7a25d7777c8b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-a70282e6-c802-4ae4-8773-7a25d7777c8b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-a70282e6-c802-4ae4-8773-7a25d7777c8b" acquired by "delete_volume" :: waited 0.044s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb3a67-83fa-4acb-a2de-03c6bf966b93]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:08 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b
Sep 23 00:22:08 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Flow 'volume_create_manager' (797e3433-26ca-4737-8cbb-9dc55016fd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615cb390-2aa9-4b64-96e1-129e8b7bdce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615cb390-2aa9-4b64-96e1-129e8b7bdce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1125429928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b08206-f153-42ae-889e-8856cbe24998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9d51ced8814b5aadc5a24f209b38f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:09Z,use_quota=True,user_id='1a310ef468754c8484107f58d3ce33ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7fdfcc-eb23-4ea9-8bff-a3649aa8fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7fdfcc-eb23-4ea9-8bff-a3649aa8fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9cc0d0-f149-4b2b-869a-cc3178a3129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:08 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:22:09 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b" returned: 0 in 0.551s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:09 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b
Sep 23 00:22:09 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9cc0d0-f149-4b2b-869a-cc3178a3129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19b08206-f153-42ae-889e-8856cbe24998', 'volume_name': 'volume-19b08206-f153-42ae-889e-8856cbe24998', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f46d19a0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e29988b-9a9b-42e3-a666-0e94cc2f97b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e29988b-9a9b-42e3-a666-0e94cc2f97b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed89865-e505-4232-ae23-49827e10b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Volume 19b08206-f153-42ae-889e-8856cbe24998: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19b08206-f153-42ae-889e-8856cbe24998', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f46d19a0>}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Trying to clone 19b08206-f153-42ae-889e-8856cbe24998 from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:22:09 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a70282e6-c802-4ae4-8773-7a25d7777c8b" returned: 0 in 0.353s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-a70282e6-c802-4ae4-8773-7a25d7777c8b" released by "delete_volume" :: held 0.990s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Created reservations ['d32fab70-2aa5-4152-b219-b774a7cdd124', 'cee7798d-067c-4322-ac32-06c49024829e', 'c0ccc0a8-478e-4134-8f8b-29f1cb022d2f', '40fbed3b-9460-4cf2-91f2-f97b11ff6092'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:22:09 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[98514bad-c80f-4ed5-8a7e-3dde77d6e070]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:10 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:10 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:10 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD
Sep 23 00:22:10 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:10 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.318s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de883100-428d-4539-8385-f7d25eda30d1 tempest-VolumesGetTest-810535255 None] Lock "cinder-a70282e6-c802-4ae4-8773-7a25d7777c8b-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:10 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 is fetched for user 1a310ef468754c8484107f58d3ce33ca. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac0f80-6c40-4c9f-99e0-9d581aa2659e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:10 devstack sudo[97467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD
Sep 23 00:22:10 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "cinder-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:11 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1125429928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b08206-f153-42ae-889e-8856cbe24998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9d51ced8814b5aadc5a24f209b38f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:09Z,use_quota=True,user_id='1a310ef468754c8484107f58d3ce33ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Creating volume 19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:11 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76c58a-2abc-45b1-a197-c66c5b4de03b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1073741824
Sep 23 00:22:11 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack sudo[97473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f
Sep 23 00:22:11 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" returned: 0 in 0.531s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f
Sep 23 00:22:11 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:11 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1073741824" returned: 0 in 0.611s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:11 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998
Sep 23 00:22:11 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:12 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" returned: 0 in 0.467s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f" released by "delete_volume" :: held 1.094s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Created reservations ['abed5ab9-55cc-4568-a945-1799944fcfff', '55dbdacf-8db3-41e2-b886-1d79ca6c2214', '6b386dbb-39fc-449e-8635-d6f18f9b6908', 'a4f154b6-2b5c-4348-8460-b586659aa5fc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:12 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Attempting download of 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 19b08206-f153-42ae-889e-8856cbe24998. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:12 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:12 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c9f97-bf39-49a3-96c6-117039fd5f64]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:12 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta
Sep 23 00:22:12 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:12 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.381s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9821fb85-54e5-4cca-976c-4e7e2e2deba2 tempest-VolumesGetTest-810535255 None] Lock "cinder-e5de507b-7e02-4976-9f03-fc8d6f3c8f0f-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:12 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta" returned: 0 in 0.485s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta
Sep 23 00:22:13 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-c104f0a4-8d6a-465e-bab7-33e08dd69942-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:13 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta" returned: 1 in 0.512s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_9zn7p_ta' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "cinder-c104f0a4-8d6a-465e-bab7-33e08dd69942-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f228f9-ef70-4047-87e8-6a624c51186c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-c104f0a4-8d6a-465e-bab7-33e08dd69942" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-c104f0a4-8d6a-465e-bab7-33e08dd69942" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:13 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD
Sep 23 00:22:13 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3402a146-74db-409c-9278-aa45d6c5c709]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:13 devstack sudo[97502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:22:13 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:14 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD" returned: 0 in 0.561s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:14 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998
Sep 23 00:22:14 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:14 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 0.671s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:14 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942
Sep 23 00:22:14 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:14 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c104f0a4-8d6a-465e-bab7-33e08dd69942" returned: 0 in 0.455s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-c104f0a4-8d6a-465e-bab7-33e08dd69942" released by "delete_volume" :: held 1.248s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:14 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Created reservations ['4e343602-6145-432a-b363-3bbf415ad890', '6eb6ce6f-3953-4d9d-a692-41fa6455ab26', 'fc015ceb-e952-419e-aa67-3729d1d34103', '43d2147f-df1b-4c0d-8e73-876f9448de42'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:15 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:15 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:15 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.477s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:22:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ad13f482-1d70-4542-8640-842abd6bdcb2 tempest-VolumesGetTest-810535255 None] Lock "cinder-c104f0a4-8d6a-465e-bab7-33e08dd69942-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (dbe28de6-0e7b-4b3b-a9e4-0464f3950438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:16 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f32753-d92f-4b68-aa21-548ad8408d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998" returned: 0 in 2.925s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_lbhlhsk3devstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:22:16 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Converted 112.00 MB image at 38.28 MB/s
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f32753-d92f-4b68-aa21-548ad8408d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1224637195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8fa11f-d73d-468a-8122-1be4c9c914c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:17Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:16 devstack sudo[97552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1G
Sep 23 00:22:16 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2b508d-7def-407e-9d36-632e4059e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2b508d-7def-407e-9d36-632e4059e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a906547-3a92-458d-9495-0ca771dafe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a906547-3a92-458d-9495-0ca771dafe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a8fa11f-d73d-468a-8122-1be4c9c914c2', 'volume_name': 'volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45b87d0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99c4d87-70c8-4a2c-bf25-3e758f53df32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99c4d87-70c8-4a2c-bf25-3e758f53df32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948a5bb-cfd7-46e4-b066-05f6108517cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45b87d0>}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Trying to clone 9a8fa11f-d73d-468a-8122-1be4c9c914c2 from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:22:17 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 1G" returned: 0 in 0.520s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Downloaded image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 19b08206-f153-42ae-889e-8856cbe24998 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 for user 1a310ef468754c8484107f58d3ce33ca is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Marking volume 19b08206-f153-42ae-889e-8856cbe24998 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Copying metadata from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 to 19b08206-f153-42ae-889e-8856cbe24998. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Creating volume glance metadata for volume 19b08206-f153-42ae-889e-8856cbe24998 backed by image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed89865-e505-4232-ae23-49827e10b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b08206-f153-42ae-889e-8856cbe24998', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f46d19a0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bfc4bb-16d3-42f0-ad12-7edd4645d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Volume volume-19b08206-f153-42ae-889e-8856cbe24998 (19b08206-f153-42ae-889e-8856cbe24998): created successfully
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bfc4bb-16d3-42f0-ad12-7edd4645d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Flow 'volume_create_manager' (797e3433-26ca-4737-8cbb-9dc55016fd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d5aa3f96-a811-4507-8796-5aa4f080226b tempest-VolumesImageMetadata-2011569261 None] Created volume successfully.
Sep 23 00:22:17 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:22:17 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[999b8217-ea2a-4e1e-93f5-41dbc64132ea]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:18 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD
Sep 23 00:22:18 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:18 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 is fetched for user 72db584966474084a8059ec6959bb86f. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9382b8-c070-472e-952e-22346926b651]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:18 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD
Sep 23 00:22:18 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:18 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1224637195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8fa11f-d73d-468a-8122-1be4c9c914c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:17Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Creating volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:18 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:18 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1073741824
Sep 23 00:22:18 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Acquiring lock "cinder-19b08206-f153-42ae-889e-8856cbe24998-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "cinder-19b08206-f153-42ae-889e-8856cbe24998-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Acquiring lock "cinder-quobyte-19b08206-f153-42ae-889e-8856cbe24998" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "cinder-quobyte-19b08206-f153-42ae-889e-8856cbe24998" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601dd5d-8627-4f12-9370-d9ed29ef91c2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:19 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1073741824" returned: 0 in 0.560s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:19 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998
Sep 23 00:22:19 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:19 devstack sudo[97582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2
Sep 23 00:22:19 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:19 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998" returned: 0 in 0.526s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:19 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:19 devstack sudo[97588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998
Sep 23 00:22:19 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:19 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Attempting download of 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f317790-c494-4001-8db9-74e8a2686408]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:20 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv
Sep 23 00:22:20 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:20 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-19b08206-f153-42ae-889e-8856cbe24998" returned: 0 in 0.360s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "cinder-quobyte-19b08206-f153-42ae-889e-8856cbe24998" released by "delete_volume" :: held 0.949s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Created reservations ['83fc25d4-e391-4bab-8383-e15beeac57b3', '20046b1e-fc37-46ce-8eda-0368395d064f', 'b5083e54-56dd-4c49-bea0-d4ac07eb639f', 'e5f018b5-789c-4bf4-ba9a-a9492dee562d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:20 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:20 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:20 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:20 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv
Sep 23 00:22:20 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:20 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.411s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:20 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Deleted volume successfully.
Sep 23 00:22:20 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv" returned: 1 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_u67gcswv' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-252b8e8c-4749-48ce-9222-a277f8cf3d42 tempest-VolumesImageMetadata-2011569261 None] Lock "cinder-19b08206-f153-42ae-889e-8856cbe24998-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdef854d-b8b8-40d4-b300-45f9aacda825]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:21 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD
Sep 23 00:22:21 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:21 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:22:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:21 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2
Sep 23 00:22:21 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:24 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2" returned: 0 in 2.834s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_j1zx6fm0devstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:22:24 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Converted 112.00 MB image at 39.46 MB/s
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:24 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1G
Sep 23 00:22:24 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:24 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 1G" returned: 0 in 0.702s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Downloaded image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 for user 72db584966474084a8059ec6959bb86f is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:22:24 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Marking volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Copying metadata from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 to 9a8fa11f-d73d-468a-8122-1be4c9c914c2. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Creating volume glance metadata for volume 9a8fa11f-d73d-468a-8122-1be4c9c914c2 backed by image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948a5bb-cfd7-46e4-b066-05f6108517cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f45b87d0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877880e4-28b1-4c68-9e83-a436f04651a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Volume volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 (9a8fa11f-d73d-468a-8122-1be4c9c914c2): created successfully
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877880e4-28b1-4c68-9e83-a436f04651a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (dbe28de6-0e7b-4b3b-a9e4-0464f3950438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-568f0229-9a0b-4306-87ac-1043ea305581 tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (9a36f7ec-3043-4f2d-8b30-0956912d91a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6468f081-ca93-4560-902f-59a802f6d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6468f081-ca93-4560-902f-59a802f6d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-840030303',display_name='tempest-VolumesGetTest-Volume-1583501488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef4895-692a-403c-935d-6640f0baf581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:27Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77032751-9a2f-470a-8ef8-80021704cbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77032751-9a2f-470a-8ef8-80021704cbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7266be-d9c9-4bf8-a952-e1305204805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7266be-d9c9-4bf8-a952-e1305204805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ef4895-692a-403c-935d-6640f0baf581', 'volume_name': 'volume-93ef4895-692a-403c-935d-6640f0baf581', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c3d4ff-aed3-42ec-9c81-8d102c2dd0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c3d4ff-aed3-42ec-9c81-8d102c2dd0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6705a095-d41d-481a-a3c8-a0b9b3f09b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:27 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Volume 93ef4895-692a-403c-935d-6640f0baf581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ef4895-692a-403c-935d-6640f0baf581', 'volume_size': 1}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-840030303',display_name='tempest-VolumesGetTest-Volume-1583501488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef4895-692a-403c-935d-6640f0baf581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1381cf190e646c888a055655c07c6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:27Z,use_quota=True,user_id='72db584966474084a8059ec6959bb86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Creating volume 93ef4895-692a-403c-935d-6640f0baf581 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:27 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:27 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 1073741824
Sep 23 00:22:27 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:28 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 1073741824" returned: 0 in 0.944s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:28 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581
Sep 23 00:22:28 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:28 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581" returned: 0 in 0.447s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6705a095-d41d-481a-a3c8-a0b9b3f09b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ef4895-692a-403c-935d-6640f0baf581', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9167e56a-234e-4aba-9d01-0f70af94cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Volume volume-93ef4895-692a-403c-935d-6640f0baf581 (93ef4895-692a-403c-935d-6640f0baf581): created successfully
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9167e56a-234e-4aba-9d01-0f70af94cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Flow 'volume_create_manager' (9a36f7ec-3043-4f2d-8b30-0956912d91a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-413e2a9a-fb8c-4e5d-bcdc-e58f3d1f6b92 tempest-VolumesGetTest-810535255 None] Created volume successfully.
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Flow 'volume_create_manager' (6d651df8-7934-46e2-b9c8-99a74443ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761c78e3-1cf7-41d6-9ca7-6d4c6c6d1108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761c78e3-1cf7-41d6-9ca7-6d4c6c6d1108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1480302727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7c09f-f868-466c-aff0-f45a8fe8ee3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846ba110b938479b8a656b53a7ecda91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:29Z,use_quota=True,user_id='a0b68f0916eb420596d9fc2995b2f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb799d41-97eb-4345-a893-126b8d2bbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb799d41-97eb-4345-a893-126b8d2bbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3e01fb-e5a1-4d97-9c96-d5867d6f54c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3e01fb-e5a1-4d97-9c96-d5867d6f54c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d7c09f-f868-466c-aff0-f45a8fe8ee3f', 'volume_name': 'volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f00331b-88ee-4764-a18c-8c0b56ea40d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f00331b-88ee-4764-a18c-8c0b56ea40d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f5d846-05b6-4434-a52e-b3ac8e7153a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:28 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Volume 11d7c09f-f868-466c-aff0-f45a8fe8ee3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f', 'volume_size': 1}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1480302727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7c09f-f868-466c-aff0-f45a8fe8ee3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846ba110b938479b8a656b53a7ecda91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:29Z,use_quota=True,user_id='a0b68f0916eb420596d9fc2995b2f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Creating volume 11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:28 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:29 devstack sudo[97659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f 1073741824
Sep 23 00:22:29 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-93ef4895-692a-403c-935d-6640f0baf581-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "cinder-93ef4895-692a-403c-935d-6640f0baf581-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-93ef4895-692a-403c-935d-6640f0baf581" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-93ef4895-692a-403c-935d-6640f0baf581" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[743dc6e9-9023-4c5e-b3bc-85a2f08da14a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:29 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f 1073741824" returned: 0 in 0.765s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:29 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581
Sep 23 00:22:29 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:29 devstack sudo[97666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f
Sep 23 00:22:29 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:30 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:30 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581" returned: 0 in 0.595s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" returned: 0 in 0.354s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:30 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581
Sep 23 00:22:30 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f5d846-05b6-4434-a52e-b3ac8e7153a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1add216b-4bff-46bd-8d7e-7a452574c3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Volume volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f (11d7c09f-f868-466c-aff0-f45a8fe8ee3f): created successfully
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1add216b-4bff-46bd-8d7e-7a452574c3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Flow 'volume_create_manager' (6d651df8-7934-46e2-b9c8-99a74443ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ebb8bdfb-593f-41bf-9f5c-4fac0377034a tempest-SnapshotMetadataTestJSON-245854192 None] Created volume successfully.
Sep 23 00:22:30 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93ef4895-692a-403c-935d-6640f0baf581" returned: 0 in 0.327s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-93ef4895-692a-403c-935d-6640f0baf581" released by "delete_volume" :: held 1.004s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Created reservations ['77740a65-8432-44ee-9ac0-94940297e752', 'fd2466ba-b067-4229-82ae-395953307b08', '600676b3-036d-4b11-939a-3bd906df0dd2', '9a5b3576-3b10-4eeb-89dc-febf41f6ecb7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:30 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:30 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:31 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.382s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80672d28-3017-4abc-a25c-d5ffd3605276 tempest-VolumesGetTest-810535255 None] Lock "cinder-93ef4895-692a-403c-935d-6640f0baf581-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Creating offline snapshot c1a07cde-18c4-4324-96ea-0979bb010843 of volume 11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276cc80-8320-4ea9-beeb-cf1da9559976]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:31 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f
Sep 23 00:22:31 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-c09c8f85-463d-40a3-a7f5-46f00a68e0f9 req-e228d774-72c6-4ff7-9cb8-5d1572c1845e tempest-AttachVolumeNegativeTest-768989548 None] Terminate volume connection completed successfully.
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-c09c8f85-463d-40a3-a7f5-46f00a68e0f9 req-e228d774-72c6-4ff7-9cb8-5d1572c1845e tempest-AttachVolumeNegativeTest-768989548 None] Deleting attachment 2af2fb71-2242-4018-9bf9-2272f7af759f. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-9a8fa11f-d73d-468a-8122-1be4c9c914c2-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "cinder-9a8fa11f-d73d-468a-8122-1be4c9c914c2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Acquiring lock "cinder-quobyte-9a8fa11f-d73d-468a-8122-1be4c9c914c2" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:32 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-9a8fa11f-d73d-468a-8122-1be4c9c914c2" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" returned: 0 in 0.676s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c811ff-c7de-4c18-94d6-c23b190a95c5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 1G
Sep 23 00:22:32 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:32 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2
Sep 23 00:22:32 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:32 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 1G" returned: 0 in 0.596s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843
Sep 23 00:22:32 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:32 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2" returned: 0 in 0.632s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:32 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2
Sep 23 00:22:32 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:33 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9a8fa11f-d73d-468a-8122-1be4c9c914c2" returned: 0 in 0.322s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "cinder-quobyte-9a8fa11f-d73d-468a-8122-1be4c9c914c2" released by "delete_volume" :: held 1.058s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:33 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Created reservations ['bc3c71fa-3bbf-4b3c-9652-3dd57060021c', 'ba279261-c484-4272-b85e-4ebf8ac8dc7f', '9c793b29-21ec-454f-941b-3eea40468dce', 'ab66d12d-c618-4adb-98f8-32b492171530'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843" returned: 0 in 0.631s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 is being set with open permissions: ugo+rw
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843
Sep 23 00:22:33 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:33 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:33 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.336s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Deleted volume successfully.
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a3f69201-388f-431f-8f00-1e75b10df57e tempest-VolumesGetTest-810535255 None] Lock "cinder-9a8fa11f-d73d-468a-8122-1be4c9c914c2-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:33 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info
Sep 23 00:22:33 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:34 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:34 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info is being set with open permissions: ugo+rw
Sep 23 00:22:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:34 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info
Sep 23 00:22:34 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:34 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.info" returned: 0 in 0.437s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-353b0db8-01ba-4dbf-82c3-87289bacb589 tempest-SnapshotMetadataTestJSON-245854192 None] Create snapshot completed successfully
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "cinder-c1a07cde-18c4-4324-96ea-0979bb010843-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-c1a07cde-18c4-4324-96ea-0979bb010843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "cinder-quobyte-c1a07cde-18c4-4324-96ea-0979bb010843" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-c1a07cde-18c4-4324-96ea-0979bb010843" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Deleting offline snapshot c1a07cde-18c4-4324-96ea-0979bb010843 of volume 11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] snapshot_file for this snap is: volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663c415-019d-4fd8-842e-9ff0ed003d5b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:37 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843
Sep 23 00:22:37 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:37 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843" returned: 0 in 0.529s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd54fd1-e839-4fb5-9b6c-0e26f1c6ce7e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:37 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f
Sep 23 00:22:37 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:38 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:38 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843
Sep 23 00:22:38 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:38 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843" returned: 0 in 0.614s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:39 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843
Sep 23 00:22:39 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:39 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f.c1a07cde-18c4-4324-96ea-0979bb010843" returned: 0 in 0.433s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-c1a07cde-18c4-4324-96ea-0979bb010843" released by "_delete_snapshot" :: held 2.399s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" released by "delete_snapshot" :: held 2.437s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Created reservations ['76b980c5-5146-465f-adee-1078b83a699c', 'e40d2a57-90d8-480d-a20e-041edbf83ea0', '5bef4cef-6d95-40dc-864e-e000e0ee5d72', '1119e36e-7e5d-47d8-887a-8d94a19ac964'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Delete snapshot completed successfully.
Sep 23 00:22:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d4f79f9d-af6b-43fa-a424-7366b6b17193 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-c1a07cde-18c4-4324-96ea-0979bb010843-delete_snapshot" released by "delete_snapshot" :: held 2.680s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "cinder-11d7c09f-f868-466c-aff0-f45a8fe8ee3f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-11d7c09f-f868-466c-aff0-f45a8fe8ee3f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf065229-cb9d-4b12-81c6-7de707e2568e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:40 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f
Sep 23 00:22:40 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:41 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" returned: 0 in 0.567s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:41 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f
Sep 23 00:22:41 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:41 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" returned: 0 in 0.323s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-quobyte-11d7c09f-f868-466c-aff0-f45a8fe8ee3f" released by "delete_volume" :: held 0.999s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Created reservations ['ae2017f3-e6ce-4666-a02d-3a326ab804f7', '3bc82b8d-6fe5-43c3-a241-36139ab15b23', 'c05f817e-22a7-4b9c-8ef3-330dead879e1', '5570f4ee-4b5e-45e7-8544-a912bb102dba'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:41 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:41 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:42 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.414s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:42 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Deleted volume successfully.
Sep 23 00:22:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1405a18-4e10-4423-9069-9ddee2153680 tempest-SnapshotMetadataTestJSON-245854192 None] Lock "cinder-11d7c09f-f868-466c-aff0-f45a8fe8ee3f-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (30a07486-555f-4920-ba1a-0b1c413e4feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eef8b7-e870-4805-a1d6-48ebd71f99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eef8b7-e870-4805-a1d6-48ebd71f99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1049267158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb3da0-fab8-4117-9d24-28304d2ef2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fc9c2d20b4985874f48721c4da140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:49Z,use_quota=True,user_id='f5b164269acb4bc59fd7b1aac650ac20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a25d628-ce15-4fb2-8a9e-8ad10e96528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a25d628-ce15-4fb2-8a9e-8ad10e96528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaed6ada-2c04-4452-9133-02ec7188aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaed6ada-2c04-4452-9133-02ec7188aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fb3da0-fab8-4117-9d24-28304d2ef2db', 'volume_name': 'volume-63fb3da0-fab8-4117-9d24-28304d2ef2db', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2e8195-dfe9-4564-8d60-4ed8cda63fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2e8195-dfe9-4564-8d60-4ed8cda63fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2126e58-7cf3-49e1-a684-0f2806803f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:49 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Volume 63fb3da0-fab8-4117-9d24-28304d2ef2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fb3da0-fab8-4117-9d24-28304d2ef2db', 'volume_size': 1}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1049267158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb3da0-fab8-4117-9d24-28304d2ef2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fc9c2d20b4985874f48721c4da140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:49Z,use_quota=True,user_id='f5b164269acb4bc59fd7b1aac650ac20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Creating volume 63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:22:49 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:22:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:49 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db 1073741824
Sep 23 00:22:49 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:50 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db 1073741824" returned: 0 in 0.713s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:50 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:22:50 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:50 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.565s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2126e58-7cf3-49e1-a684-0f2806803f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fb3da0-fab8-4117-9d24-28304d2ef2db', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14cf38f-a219-445e-b4c1-462c05a626ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:22:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Volume volume-63fb3da0-fab8-4117-9d24-28304d2ef2db (63fb3da0-fab8-4117-9d24-28304d2ef2db): created successfully
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14cf38f-a219-445e-b4c1-462c05a626ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:22:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (30a07486-555f-4920-ba1a-0b1c413e4feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:22:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d9b530a4-d412-4dd0-96ce-d6cb48e97c54 tempest-VolumesDeleteCascade-262962026 None] Created volume successfully.
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Creating offline snapshot 212e6a7b-ce60-463d-9453-4664dc23559b of volume 63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb3a5c-5fd4-42c8-8bd9-91e79ba7d13b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:52 devstack sudo[97914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:22:52 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:52 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.641s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:52 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b 1G
Sep 23 00:22:52 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:53 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b 1G" returned: 0 in 0.987s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:53 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:22:53 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:54 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.538s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:54 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b is being set with open permissions: ugo+rw
Sep 23 00:22:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:54 devstack sudo[97936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:22:54 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:54 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.493s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:54 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info
Sep 23 00:22:54 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:55 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info" returned: 0 in 0.663s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:55 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info is being set with open permissions: ugo+rw
Sep 23 00:22:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:55 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info
Sep 23 00:22:55 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:56 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.info" returned: 0 in 0.580s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3f626334-45a4-4e8d-a362-19e83df9ab2f tempest-VolumesDeleteCascade-262962026 None] Create snapshot completed successfully
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Creating offline snapshot 83c7b48e-0f95-42ed-a5e6-bdb156c56537 of volume 63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:22:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c977e-4be8-4469-a69f-d79ed6151d53]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:57 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:22:57 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:57 devstack sudo[97948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:22:57 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:57 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:22:57 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.866s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb3da0-fab8-4117-9d24-28304d2ef2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:22:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:57 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 1G
Sep 23 00:22:57 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:58 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 1G" returned: 0 in 0.985s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:58 devstack sudo[97962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:22:58 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:59 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.509s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:59 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 is being set with open permissions: ugo+rw
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:22:59 devstack sudo[97968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:22:59 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:22:59 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=73,cinder:UPDATE=96,cinder:INSERT=36,cinder:DELETE=8 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=83,cinder:SELECT=84,cinder:DELETE=8,cinder:INSERT=31 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:22:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:22:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4076f486-8788-430d-bad9-7307261c5924 tempest-VolumesDeleteCascade-262962026 None] Create snapshot completed successfully
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-63fb3da0-fab8-4117-9d24-28304d2ef2db-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-63fb3da0-fab8-4117-9d24-28304d2ef2db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Performing cascade delete. {{(pid=86631) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-212e6a7b-ce60-463d-9453-4664dc23559b-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-212e6a7b-ce60-463d-9453-4664dc23559b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-212e6a7b-ce60-463d-9453-4664dc23559b" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-212e6a7b-ce60-463d-9453-4664dc23559b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Deleting offline snapshot 212e6a7b-ce60-463d-9453-4664dc23559b of volume 63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] snapshot_file for this snap is: volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7136bf-442b-4006-b620-b39511d85f01]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:00 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:23:00 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:01 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.610s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb3da0-fab8-4117-9d24-28304d2ef2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20cb3e-a9c3-412c-9d79-176cce8664f0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:01 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:23:01 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (45235458-d855-4be7-a8c9-0bb22590fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb92b1e9-e8c2-494f-a48a-8ecb29d3a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb92b1e9-e8c2-494f-a48a-8ecb29d3a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-464409970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9531cf-551c-4e07-9c96-483824cb2f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:01Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a4ec0c-99d1-4961-8549-72341b7427cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a4ec0c-99d1-4961-8549-72341b7427cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb6b827-8361-4675-a64d-711a2828f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb6b827-8361-4675-a64d-711a2828f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9531cf-551c-4e07-9c96-483824cb2f7b', 'volume_name': 'volume-6d9531cf-551c-4e07-9c96-483824cb2f7b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327fc76f-b5d3-446a-92c0-5df887f9e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327fc76f-b5d3-446a-92c0-5df887f9e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e692c0f0-3c8f-41a7-9490-006f23328033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume 6d9531cf-551c-4e07-9c96-483824cb2f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9531cf-551c-4e07-9c96-483824cb2f7b', 'volume_size': 1}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-464409970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9531cf-551c-4e07-9c96-483824cb2f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:01Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Creating volume 6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:01 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:01 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b 1073741824
Sep 23 00:23:01 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:01 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.485s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0ed574-c672-49d0-bd0b-eff93814f5c8]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:01 devstack sudo[97983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:23:01 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:02 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b 1073741824" returned: 0 in 0.573s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:02 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b
Sep 23 00:23:02 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:02 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.545s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb3da0-fab8-4117-9d24-28304d2ef2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f30c2e-c7f3-4bca-9053-1e4c717edc92]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:02 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:23:02 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:02 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b" returned: 0 in 0.409s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e692c0f0-3c8f-41a7-9490-006f23328033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9531cf-551c-4e07-9c96-483824cb2f7b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e285b8-b35e-45a8-aeba-56e9b9bc2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume volume-6d9531cf-551c-4e07-9c96-483824cb2f7b (6d9531cf-551c-4e07-9c96-483824cb2f7b): created successfully
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e285b8-b35e-45a8-aeba-56e9b9bc2c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (45235458-d855-4be7-a8c9-0bb22590fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b89e2037-ce23-40f6-b3c3-29b50e4f1f14 tempest-VolumesSnapshotTestJSON-1639239918 None] Created volume successfully.
Sep 23 00:23:02 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb3da0-fab8-4117-9d24-28304d2ef2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f274d7a-340d-474d-a054-be4ec24677cf]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:02 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:23:02 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:03 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.436s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:03 devstack sudo[98006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:23:03 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:03 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:03 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b
Sep 23 00:23:03 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Creating offline snapshot c936caed-588e-4cc9-817a-58a3d6abd953 of volume 6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b46ac-51db-4344-a1de-43157afb20ab]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:04 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.212e6a7b-ce60-463d-9453-4664dc23559b" returned: 0 in 0.323s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 -F qcow2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:04 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b
Sep 23 00:23:04 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:04 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 -F qcow2
Sep 23 00:23:04 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:04 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b" returned: 0 in 0.462s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:04 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 1G
Sep 23 00:23:04 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:04 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb3da0-fab8-4117-9d24-28304d2ef2db /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 -F qcow2" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-212e6a7b-ce60-463d-9453-4664dc23559b" released by "_delete_snapshot" :: held 4.137s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" released by "delete_snapshot" :: held 4.177s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Created reservations ['a598e8ef-f146-47b9-9179-acbd22e00faf', 'd1aba412-633e-4b27-91a8-216198f09a9e', 'f90ef854-384a-4f00-a975-dbe2622262cb', 'f193dabf-ba1d-46cd-a3af-89e674569cfe'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:04 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Delete snapshot completed successfully.
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-212e6a7b-ce60-463d-9453-4664dc23559b-delete_snapshot" released by "delete_snapshot" :: held 4.450s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-83c7b48e-0f95-42ed-a5e6-bdb156c56537-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-83c7b48e-0f95-42ed-a5e6-bdb156c56537-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-83c7b48e-0f95-42ed-a5e6-bdb156c56537" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-83c7b48e-0f95-42ed-a5e6-bdb156c56537" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Deleting offline snapshot 83c7b48e-0f95-42ed-a5e6-bdb156c56537 of volume 63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] snapshot_file for this snap is: volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[531be9df-0b44-4fa6-aa4f-3fd29ffc2e02]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 1G" returned: 0 in 0.669s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9531cf-551c-4e07-9c96-483824cb2f7b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9531cf-551c-4e07-9c96-483824cb2f7b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953
Sep 23 00:23:05 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:05 devstack sudo[98031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:23:05 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:05 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9531cf-551c-4e07-9c96-483824cb2f7b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953" returned: 0 in 0.367s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:05 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 is being set with open permissions: ugo+rw
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:05 devstack sudo[98041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953
Sep 23 00:23:05 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb3da0-fab8-4117-9d24-28304d2ef2db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e77bb-7216-4a00-a0b4-3ed7bacab128]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:05 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:23:05 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:05 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953" returned: 0 in 0.351s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:06 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info
Sep 23 00:23:06 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:06 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.521s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:06 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:23:06 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:06 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info is being set with open permissions: ugo+rw
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:06 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info
Sep 23 00:23:06 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:06 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.360s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:06 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537
Sep 23 00:23:06 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:06 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.info" returned: 0 in 0.276s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0618ef02-753f-4994-9890-a779cebcac9e tempest-VolumesSnapshotTestJSON-1639239918 None] Create snapshot completed successfully
Sep 23 00:23:06 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db.83c7b48e-0f95-42ed-a5e6-bdb156c56537" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-83c7b48e-0f95-42ed-a5e6-bdb156c56537" released by "_delete_snapshot" :: held 1.897s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" released by "delete_snapshot" :: held 1.938s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:06 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Created reservations ['4e28620d-defb-4eeb-9c5f-0edd08e84285', 'b2222a9e-74cb-4695-885d-cb550d8f3f97', 'fcd659bd-60ac-448f-bdc2-7390d210694b', '2d1fd97a-4de0-4e43-a855-3568b8c80940'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Delete snapshot completed successfully.
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-83c7b48e-0f95-42ed-a5e6-bdb156c56537-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Snapshots deleted, issuing volume delete {{(pid=86631) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0694fcd7-005f-4745-bc88-67be2f92337f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:07 devstack sudo[98063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:23:07 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-c936caed-588e-4cc9-817a-58a3d6abd953-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-c936caed-588e-4cc9-817a-58a3d6abd953-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-c936caed-588e-4cc9-817a-58a3d6abd953" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c936caed-588e-4cc9-817a-58a3d6abd953" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Deleting offline snapshot c936caed-588e-4cc9-817a-58a3d6abd953 of volume 6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] snapshot_file for this snap is: volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5937829-b421-4e89-936c-c0c556fa3a30]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:07 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.617s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:07 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db
Sep 23 00:23:07 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:07 devstack sudo[98091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953
Sep 23 00:23:07 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:08 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-63fb3da0-fab8-4117-9d24-28304d2ef2db" returned: 0 in 0.347s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-63fb3da0-fab8-4117-9d24-28304d2ef2db" released by "delete_volume" :: held 1.066s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Created reservations ['30c845fb-ff5d-477f-a392-6f6e543a181c', '8315e62f-601f-43ce-9bb4-093aa8bc3d54', '497bbdd8-88ac-4939-8bf0-3f8233547caa', 'cced4aa0-5bc2-471a-b580-30451caffedc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:08 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953" returned: 0 in 0.525s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d9531cf-551c-4e07-9c96-483824cb2f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b200b-f81b-4455-94a8-ac39972ee98c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:08 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:08 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:08 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b
Sep 23 00:23:08 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:08 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.292s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Deleted volume successfully.
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ba7c0fdc-91b9-43e7-a66e-61da0e1b2b22 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-63fb3da0-fab8-4117-9d24-28304d2ef2db-delete_volume" released by "delete_volume" :: held 8.352s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:08 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b" returned: 0 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:08 devstack sudo[98108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953
Sep 23 00:23:08 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:09 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953" returned: 0 in 0.412s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:09 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953
Sep 23 00:23:09 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:09 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b.c936caed-588e-4cc9-817a-58a3d6abd953" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c936caed-588e-4cc9-817a-58a3d6abd953" released by "_delete_snapshot" :: held 1.868s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" released by "delete_snapshot" :: held 1.901s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['3af475ad-ebf9-4587-8984-128b7baa675b', '9289a897-61d0-419e-9305-236c83b275a5', '2854a3da-615f-46d2-b73b-185546966266', '8d57ab9f-264f-47e8-9466-cd1ced19e1a4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Delete snapshot completed successfully.
Sep 23 00:23:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-082872ec-3c7d-46e6-86be-f122623e06d0 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-c936caed-588e-4cc9-817a-58a3d6abd953-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (ff4d24c9-4c10-404e-81cb-a5486bfb3030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744751ca-bd53-4cb6-9f9e-352ffb1ee961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744751ca-bd53-4cb6-9f9e-352ffb1ee961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-325821783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb87621-86a1-48dc-9994-7b7614134f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fc9c2d20b4985874f48721c4da140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:10Z,use_quota=True,user_id='f5b164269acb4bc59fd7b1aac650ac20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403e68a8-27bc-424e-aa60-776cb29ac48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403e68a8-27bc-424e-aa60-776cb29ac48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58145288-93a3-4c0c-8634-7e4f89c5b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58145288-93a3-4c0c-8634-7e4f89c5b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb87621-86a1-48dc-9994-7b7614134f65', 'volume_name': 'volume-dfb87621-86a1-48dc-9994-7b7614134f65', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e83bb-3985-4cce-ba9d-3271f8643cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e83bb-3985-4cce-ba9d-3271f8643cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d883d52-363d-4d08-90c8-ea49a988e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Volume dfb87621-86a1-48dc-9994-7b7614134f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb87621-86a1-48dc-9994-7b7614134f65', 'volume_size': 1}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-325821783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb87621-86a1-48dc-9994-7b7614134f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fc9c2d20b4985874f48721c4da140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:10Z,use_quota=True,user_id='f5b164269acb4bc59fd7b1aac650ac20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Creating volume dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:10 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:10 devstack sudo[98116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 1073741824
Sep 23 00:23:10 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:11 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 1073741824" returned: 0 in 0.610s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:11 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:11 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:11 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.380s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d883d52-363d-4d08-90c8-ea49a988e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb87621-86a1-48dc-9994-7b7614134f65', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7da3d2-9a75-45a3-b4e7-a53a536ab3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Volume volume-dfb87621-86a1-48dc-9994-7b7614134f65 (dfb87621-86a1-48dc-9994-7b7614134f65): created successfully
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7da3d2-9a75-45a3-b4e7-a53a536ab3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (ff4d24c9-4c10-404e-81cb-a5486bfb3030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e49bb82-9b5f-40a8-bc28-a6a15c4e9614 tempest-VolumesDeleteCascade-262962026 None] Created volume successfully.
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (6fa15479-babb-4c19-82b0-47505d2e46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faf2b65-6cd3-41da-94b9-9af212bdb162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faf2b65-6cd3-41da-94b9-9af212bdb162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2014344292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3ee8cc-eb8d-454e-bbce-7cb89a905836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:12Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd41e48-a72c-4f8e-95fb-03940fd871fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd41e48-a72c-4f8e-95fb-03940fd871fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e9716b-d3eb-4aec-9bfc-398080bd1f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e9716b-d3eb-4aec-9bfc-398080bd1f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3ee8cc-eb8d-454e-bbce-7cb89a905836', 'volume_name': 'volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daad757a-9895-4dee-8c4d-2a9e41ece20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daad757a-9895-4dee-8c4d-2a9e41ece20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0515736-2dc2-4e48-8dbb-f61ff42c9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Volume ff3ee8cc-eb8d-454e-bbce-7cb89a905836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836', 'volume_size': 1}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2014344292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3ee8cc-eb8d-454e-bbce-7cb89a905836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:12Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Creating volume ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:11 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:11 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 1073741824
Sep 23 00:23:11 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:12 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 1073741824" returned: 0 in 0.483s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:12 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:12 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:12 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.336s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0515736-2dc2-4e48-8dbb-f61ff42c9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3a085-cb06-4837-80e7-c8279215081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Volume volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 (ff3ee8cc-eb8d-454e-bbce-7cb89a905836): created successfully
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3a085-cb06-4837-80e7-c8279215081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (6fa15479-babb-4c19-82b0-47505d2e46be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-dac17afc-2a4b-4397-88e1-0322c710631b tempest-VolumesSnapshotTestJSON-1639239918 None] Created volume successfully.
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Creating offline snapshot 7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d of volume dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f3f888-6cea-4730-977c-f7dba218575c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:12 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:12 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:13 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:13 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d 1G
Sep 23 00:23:13 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:13 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d 1G" returned: 0 in 0.648s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb87621-86a1-48dc-9994-7b7614134f65 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:13 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb87621-86a1-48dc-9994-7b7614134f65 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:13 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:14 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb87621-86a1-48dc-9994-7b7614134f65 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:14 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d is being set with open permissions: ugo+rw
Sep 23 00:23:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:14 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:14 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:14 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.362s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:14 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info
Sep 23 00:23:14 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:15 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:15 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info is being set with open permissions: ugo+rw
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:15 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info
Sep 23 00:23:15 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:15 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.info" returned: 0 in 0.291s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.381s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Creating offline snapshot 0999db77-f884-48aa-9111-0c27aaa3fddf of volume ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-101edb07-c31b-4077-ad7d-3040aea7aa87 tempest-VolumesDeleteCascade-262962026 None] Create snapshot completed successfully
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[73149170-93cc-4e7c-9d6a-df30e07dbd81]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:15 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:15 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:15 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.485s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:15 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf 1G
Sep 23 00:23:15 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:16 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf 1G" returned: 0 in 0.822s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:16 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:16 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (b7b0ed3f-baa7-47bf-af65-cd95c365c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3039bfb-9943-4173-8989-dd54994d8a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3039bfb-9943-4173-8989-dd54994d8a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-570672282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d03c555-aa1c-4f1e-a2cf-aadf3d87436b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fc9c2d20b4985874f48721c4da140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:17Z,use_quota=True,user_id='f5b164269acb4bc59fd7b1aac650ac20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743067d7-1a3f-41be-a355-5366a7352b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743067d7-1a3f-41be-a355-5366a7352b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9460f-95ca-4212-a52f-d833571c1569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9460f-95ca-4212-a52f-d833571c1569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d03c555-aa1c-4f1e-a2cf-aadf3d87436b', 'volume_name': 'volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b', 'volume_size': 1, 'snapshot_id': '7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64588d6a-60d8-4d76-ad15-294f664b149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64588d6a-60d8-4d76-ad15-294f664b149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9436bafa-a3cd-4245-98a4-99cdb4375815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Volume 7d03c555-aa1c-4f1e-a2cf-aadf3d87436b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b', 'volume_size': 1, 'snapshot_id': '7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d'}
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:17 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.461s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:17 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf is being set with open permissions: ugo+rw
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:17 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:17 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:17 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.353s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:17 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info
Sep 23 00:23:17 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:17 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info" returned: 0 in 0.354s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:17 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info is being set with open permissions: ugo+rw
Sep 23 00:23:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:18 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info
Sep 23 00:23:18 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:18 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.info" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.311s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Creating volume 7d03c555-aa1c-4f1e-a2cf-aadf3d87436b from snapshot 7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-eb59c35a-55a8-4b1d-afc1-d0acdbda270b tempest-VolumesSnapshotTestJSON-1639239918 None] Create snapshot completed successfully
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] snapshot: 7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d, volume: 7d03c555-aa1c-4f1e-a2cf-aadf3d87436b,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (b59154a7-b049-4652-93f3-57a2f17c03c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287fda66-e172-46ac-a835-c95b1754cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287fda66-e172-46ac-a835-c95b1754cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1027294824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7501975a-757a-4b99-903a-32fc0be43178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4b3b9-586a-4a0e-94ca-eef1f136ac45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4b3b9-586a-4a0e-94ca-eef1f136ac45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0388e3-7b5d-4d91-830a-2ef4c668cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0388e3-7b5d-4d91-830a-2ef4c668cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7501975a-757a-4b99-903a-32fc0be43178', 'volume_name': 'volume-7501975a-757a-4b99-903a-32fc0be43178', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e4a7a4-c93c-448f-8bb9-405f3f545155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e4a7a4-c93c-448f-8bb9-405f3f545155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4214f7-82e6-44bb-83d0-9708e3b9ad2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:18 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Volume 7501975a-757a-4b99-903a-32fc0be43178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7501975a-757a-4b99-903a-32fc0be43178', 'volume_size': 1}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e5c42-6f19-408b-ba3d-e46f00c5818c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:18 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:18 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:19 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.470s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb87621-86a1-48dc-9994-7b7614134f65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20893c-80a3-460f-8465-fdbd3a99c544]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:19 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:19 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:19 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.482s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:19 devstack sudo[98207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b
Sep 23 00:23:19 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (72c092c4-cb2b-486f-96c0-6c21fe4f09d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e43744c-3cef-4d62-8d67-33ace2fcdef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e43744c-3cef-4d62-8d67-33ace2fcdef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-134740164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24bfebe-08cb-4429-b850-1e0574efebb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0999db77-f884-48aa-9111-0c27aaa3fddf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:20Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b8b30c-62f0-4f2a-95f3-3caf681059f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b8b30c-62f0-4f2a-95f3-3caf681059f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b795a3e6-6fcd-40f8-9003-9c261edf0ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b795a3e6-6fcd-40f8-9003-9c261edf0ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c24bfebe-08cb-4429-b850-1e0574efebb1', 'volume_name': 'volume-c24bfebe-08cb-4429-b850-1e0574efebb1', 'volume_size': 2, 'snapshot_id': '0999db77-f884-48aa-9111-0c27aaa3fddf'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c90fe2-8986-46ab-b330-066df01d9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c90fe2-8986-46ab-b330-066df01d9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c60b67b-d00c-4454-a601-7f30bca31404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume c24bfebe-08cb-4429-b850-1e0574efebb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c24bfebe-08cb-4429-b850-1e0574efebb1', 'volume_size': 2, 'snapshot_id': '0999db77-f884-48aa-9111-0c27aaa3fddf'}
Sep 23 00:23:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:26 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" returned: 0 in 6.584s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:23:26 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Converted 1024.00 MB image at 155.50 MB/s
Sep 23 00:23:26 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b is being set with open permissions: ugo+rw
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:26 devstack sudo[98220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b
Sep 23 00:23:26 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:26 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" returned: 0 in 0.267s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" released by "_copy_volume_from_snapshot" :: held 7.977s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" released by "_create_volume_from_snapshot" :: held 8.065s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.114s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.892s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1027294824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7501975a-757a-4b99-903a-32fc0be43178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Creating volume 7501975a-757a-4b99-903a-32fc0be43178 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:26 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:26 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 1073741824
Sep 23 00:23:26 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9436bafa-a3cd-4245-98a4-99cdb4375815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b', 'volume_size': 1, 'snapshot_id': '7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511ff721-2392-42c2-9a25-0afc612be9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:26 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Volume volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b (7d03c555-aa1c-4f1e-a2cf-aadf3d87436b): created successfully
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511ff721-2392-42c2-9a25-0afc612be9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Flow 'volume_create_manager' (b7b0ed3f-baa7-47bf-af65-cd95c365c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d7720d88-c2aa-4be5-b7f6-6c7bcbabfdf7 tempest-VolumesDeleteCascade-262962026 None] Created volume successfully.
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-dfb87621-86a1-48dc-9994-7b7614134f65-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-dfb87621-86a1-48dc-9994-7b7614134f65-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Performing cascade delete. {{(pid=86631) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:26 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 1073741824" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Deleting offline snapshot 7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d of volume dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] snapshot_file for this snap is: volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[caca1386-475a-4d45-88ce-3a821a55281f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178
Sep 23 00:23:27 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:27 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178" returned: 0 in 0.308s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.280s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf-c24bfebe-08cb-4429-b850-1e0574efebb1" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4214f7-82e6-44bb-83d0-9708e3b9ad2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7501975a-757a-4b99-903a-32fc0be43178', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11814c29-8d00-4649-93b0-827d792275d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf-c24bfebe-08cb-4429-b850-1e0574efebb1" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Creating volume c24bfebe-08cb-4429-b850-1e0574efebb1 from snapshot 0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:27 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Volume volume-7501975a-757a-4b99-903a-32fc0be43178 (7501975a-757a-4b99-903a-32fc0be43178): created successfully
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11814c29-8d00-4649-93b0-827d792275d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (b59154a7-b049-4652-93f3-57a2f17c03c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] snapshot: 0999db77-f884-48aa-9111-0c27aaa3fddf, volume: c24bfebe-08cb-4429-b850-1e0574efebb1,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:23:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ffcb5cbc-084b-4320-8162-0f66edc71a16 tempest-AttachVolumeNegativeTest-768989548 None] Created volume successfully.
Sep 23 00:23:27 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.461s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb87621-86a1-48dc-9994-7b7614134f65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1f239-8e54-4f55-9b4c-d567759a91bd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532d83f-5f74-47e8-b23a-939765e04ed2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:27 devstack sudo[98238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:27 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:27 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:27 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.525s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b99bd7-7cd7-4df9-b7e7-2631b70bfa8f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:28 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.737s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:28 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.564s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1
Sep 23 00:23:28 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:28 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.537s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:28 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d
Sep 23 00:23:28 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:29 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65.7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" returned: 0 in 0.388s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d" released by "_delete_snapshot" :: held 2.270s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" released by "delete_snapshot" :: held 2.303s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7784fe91-8026-46b2-b6d2-4058c07d982f req-e96eb2dd-372a-40bb-b4f1-c6e48afaa5a8 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Created reservations ['02657537-7432-49ca-a39d-35904c22d02d', 'ec17a6bc-7186-4740-abb2-e5fe6d301a3e', 'e5eac7a3-90f5-4484-895c-34be0d910ec6', '690b84f8-3a6a-4a13-a492-79dad48b30e8'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Delete snapshot completed successfully.
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-7b86cfb3-91cc-4c15-ab55-72f16aa1bf9d-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Snapshots deleted, issuing volume delete {{(pid=86631) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" acquired by "delete_volume" :: waited 0.041s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1072a0df-0405-4bc0-956e-373c050d58b8]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:29 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:29 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:30 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.685s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:30 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65
Sep 23 00:23:30 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:30 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dfb87621-86a1-48dc-9994-7b7614134f65" returned: 0 in 0.541s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-dfb87621-86a1-48dc-9994-7b7614134f65" released by "delete_volume" :: held 1.386s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Created reservations ['376d6159-7bbc-47b2-a4ce-4846e8298c8d', 'fbd97675-e940-4dce-a10e-593e6a3a01db', 'd4cbf675-b40a-42aa-b4fd-00531f493725', 'a7e7aaf3-cd10-4b54-b546-8cf937700a0c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:31 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:31 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:32 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.573s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" acquired by "delete_volume" :: waited 0.048s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Deleted volume successfully.
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ed91515-2169-472c-9462-73acbbb9b998 tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-dfb87621-86a1-48dc-9994-7b7614134f65-delete_volume" released by "delete_volume" :: held 5.224s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164ce17-ba75-4825-8560-889040375b59]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:32 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b
Sep 23 00:23:32 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:32 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" returned: 0 in 0.630s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:32 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b
Sep 23 00:23:32 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:33 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-quobyte-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b" released by "delete_volume" :: held 1.440s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Created reservations ['676b1b18-a67e-4cb2-9182-dad19c6b2532', '53de6aa8-ecef-433a-ba1c-25bfff9717be', '6422389d-729d-409c-b8f6-fab6241ddd5a', '9f97bec7-0b30-4977-b3bf-029c924a6525'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:33 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:33 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.408s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:34 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Deleted volume successfully.
Sep 23 00:23:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3e864fe-4c7e-45b4-8d30-39500ad92d1e tempest-VolumesDeleteCascade-262962026 None] Lock "cinder-7d03c555-aa1c-4f1e-a2cf-aadf3d87436b-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:37 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1" returned: 0 in 8.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:23:37 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Converted 1024.00 MB image at 120.77 MB/s
Sep 23 00:23:37 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 is being set with open permissions: ugo+rw
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:37 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1
Sep 23 00:23:37 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:37 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" released by "_copy_volume_from_snapshot" :: held 10.001s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf-c24bfebe-08cb-4429-b850-1e0574efebb1" released by "_create_volume_from_snapshot" :: held 10.103s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.146s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7784fe91-8026-46b2-b6d2-4058c07d982f req-e96eb2dd-372a-40bb-b4f1-c6e48afaa5a8 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.154s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7784fe91-8026-46b2-b6d2-4058c07d982f req-e96eb2dd-372a-40bb-b4f1-c6e48afaa5a8 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c60b67b-d00c-4454-a601-7f30bca31404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24bfebe-08cb-4429-b850-1e0574efebb1', 'volume_size': 2, 'snapshot_id': '0999db77-f884-48aa-9111-0c27aaa3fddf'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d248da96-2234-4756-bfe3-fef9132ceb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume volume-c24bfebe-08cb-4429-b850-1e0574efebb1 (c24bfebe-08cb-4429-b850-1e0574efebb1): created successfully
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d248da96-2234-4756-bfe3-fef9132ceb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (72c092c4-cb2b-486f-96c0-6c21fe4f09d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7784fe91-8026-46b2-b6d2-4058c07d982f req-e96eb2dd-372a-40bb-b4f1-c6e48afaa5a8 tempest-AttachVolumeNegativeTest-768989548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-7501975a-757a-4b99-903a-32fc0be43178', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5bf1583-ef45-4221-8d60-41a7bd69dd55', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:23:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7850c084-33b2-43b5-bffb-a82953663276 tempest-VolumesSnapshotTestJSON-1639239918 None] Created volume successfully.
Sep 23 00:23:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7784fe91-8026-46b2-b6d2-4058c07d982f req-e96eb2dd-372a-40bb-b4f1-c6e48afaa5a8 tempest-AttachVolumeNegativeTest-768989548 None] attachment_update completed successfully.
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-c24bfebe-08cb-4429-b850-1e0574efebb1-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-c24bfebe-08cb-4429-b850-1e0574efebb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f5d1a-5d3e-475d-a09d-c91fd589d983]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:38 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1
Sep 23 00:23:38 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:38 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1" returned: 0 in 0.555s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:38 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1
Sep 23 00:23:38 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:38 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c24bfebe-08cb-4429-b850-1e0574efebb1" returned: 0 in 0.381s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-c24bfebe-08cb-4429-b850-1e0574efebb1" released by "delete_volume" :: held 1.009s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['2204045c-5070-48a1-96dd-61637130dcdd', 'a2867e8e-5363-4f08-b6f0-a65a90cd863f', '4e0f2466-26e6-4e3f-b850-f45670b37782', 'ae3dce9e-3ed4-486b-b69b-32d035c34c85'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:39 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:39 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:39 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Deleted volume successfully.
Sep 23 00:23:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0caa9369-7c09-46c4-8328-2f3f5372cecf tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-c24bfebe-08cb-4429-b850-1e0574efebb1-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-0999db77-f884-48aa-9111-0c27aaa3fddf-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-0999db77-f884-48aa-9111-0c27aaa3fddf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Deleting offline snapshot 0999db77-f884-48aa-9111-0c27aaa3fddf of volume ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] snapshot_file for this snap is: volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b30fd5-387f-49e9-b20b-d27891d9e7d2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:40 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:40 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-05bffe9d-af68-43cc-b86d-0b6cb4209ca1 req-70977c82-d2bc-4950-8867-e52a6c66b5df tempest-AttachVolumeNegativeTest-768989548 None] Terminate volume connection completed successfully.
Sep 23 00:23:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-05bffe9d-af68-43cc-b86d-0b6cb4209ca1 req-70977c82-d2bc-4950-8867-e52a6c66b5df tempest-AttachVolumeNegativeTest-768989548 None] Deleting attachment a5bf1583-ef45-4221-8d60-41a7bd69dd55. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:23:41 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.582s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25e854-494d-4c40-a09e-3c4cdb0b8e1b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Flow 'volume_create_manager' (cc3e98cc-0fe7-4014-a902-8db3f15040ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:41 devstack sudo[98812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:41 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c9b24-e232-414b-8826-e31364faf4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c9b24-e232-414b-8826-e31364faf4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-297868114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1eb021-1abe-4e8e-b9da-ef2eabbc256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03addb182e947aaa67f5e1a85bff1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:41Z,use_quota=True,user_id='b79ec527fdac4b5d8d317a6faa475044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01c5dc0-ec89-49ff-89af-a4abb3da5e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01c5dc0-ec89-49ff-89af-a4abb3da5e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc453d6-ba89-48d8-bdfd-7e693b47ddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc453d6-ba89-48d8-bdfd-7e693b47ddd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1eb021-1abe-4e8e-b9da-ef2eabbc256b', 'volume_name': 'volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b', 'volume_size': 2}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebcf865-941d-4852-be20-591a536e6136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebcf865-941d-4852-be20-591a536e6136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0e5b54-63d0-4cd8-af8a-6e26c4bac2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Volume 5c1eb021-1abe-4e8e-b9da-ef2eabbc256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b', 'volume_size': 2}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-297868114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1eb021-1abe-4e8e-b9da-ef2eabbc256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03addb182e947aaa67f5e1a85bff1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:41Z,use_quota=True,user_id='b79ec527fdac4b5d8d317a6faa475044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Creating volume 5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:41 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b 2147483648 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:41 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b 2147483648
Sep 23 00:23:41 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:41 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.781s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:41 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:41 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:42 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b 2147483648" returned: 0 in 0.842s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:42 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b
Sep 23 00:23:42 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:42 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.730s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:42 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf
Sep 23 00:23:42 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:42 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" returned: 0 in 0.370s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0e5b54-63d0-4cd8-af8a-6e26c4bac2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b', 'volume_size': 2}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23509736-d75b-476a-9a63-e4a1dcf3d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Volume volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b (5c1eb021-1abe-4e8e-b9da-ef2eabbc256b): created successfully
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23509736-d75b-476a-9a63-e4a1dcf3d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Flow 'volume_create_manager' (cc3e98cc-0fe7-4014-a902-8db3f15040ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-172bcc0d-bb91-482d-a3fe-818e74e021f0 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Created volume successfully.
Sep 23 00:23:42 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836.0999db77-f884-48aa-9111-0c27aaa3fddf" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-0999db77-f884-48aa-9111-0c27aaa3fddf" released by "_delete_snapshot" :: held 2.572s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" released by "delete_snapshot" :: held 2.604s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['c34501ec-c0df-47fc-90dc-47bf29f262a6', 'afd605e7-c6a5-469f-92d8-19248542d0e1', 'a68746eb-2b31-4557-a5f6-83a3a62f868c', '49c6cd09-4bb4-4222-9b24-aafe31fb86e5'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Delete snapshot completed successfully.
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d98b161-0b82-4f60-bb68-4d4232daf092 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-0999db77-f884-48aa-9111-0c27aaa3fddf-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Creating offline snapshot 9625b2c1-0dda-4d9f-9d45-8d2116c07a4e of volume 5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-ff3ee8cc-eb8d-454e-bbce-7cb89a905836-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab69179a-d525-4217-9bef-8bf9914df97a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-ff3ee8cc-eb8d-454e-bbce-7cb89a905836-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:43 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b
Sep 23 00:23:43 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb910ee-4acf-4989-ad6c-579f25ac1292]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:44 devstack sudo[98863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:44 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:44 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e 2G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:44 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e 2G
Sep 23 00:23:44 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:44 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.719s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:44 devstack sudo[98875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836
Sep 23 00:23:44 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:45 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" returned: 0 in 0.434s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-ff3ee8cc-eb8d-454e-bbce-7cb89a905836" released by "delete_volume" :: held 1.266s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['cbbb255d-09e9-4f37-bf3b-7137127d2dc9', '3f67a929-7645-4400-8ef5-8fe3e57b2af1', 'a5a234cf-0384-4060-80f5-9c1a31975cf4', '808f74f6-0900-42f5-89c6-7c421a7c5cf7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:45 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e 2G" returned: 0 in 0.826s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:45 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e
Sep 23 00:23:45 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:45 devstack sudo[98884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:45 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:45 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.301s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Deleted volume successfully.
Sep 23 00:23:45 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" returned: 0 in 0.423s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:45 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e is being set with open permissions: ugo+rw
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1ee8a295-dd1d-4d75-81da-94d445475b54 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-ff3ee8cc-eb8d-454e-bbce-7cb89a905836-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:45 devstack sudo[98890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e
Sep 23 00:23:45 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:46 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:46 devstack sudo[98893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info
Sep 23 00:23:46 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:46 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:46 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info is being set with open permissions: ugo+rw
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:46 devstack sudo[98897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info
Sep 23 00:23:46 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:46 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.info" returned: 0 in 0.408s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:47 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c2c6f642-ded3-4032-8565-b4d5b3ae6daa tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Create snapshot completed successfully
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (e7026eb1-696e-4dad-abd2-7c33d7b9a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57732fac-c378-42d6-ac9a-12f654237a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57732fac-c378-42d6-ac9a-12f654237a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-62827481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f48b7d6-e73f-4c93-b179-1e7a8de929fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:47Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880a634c-9ff6-4ce7-8f03-a6f93967df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880a634c-9ff6-4ce7-8f03-a6f93967df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bea5f0-f0dc-4e01-b04f-136ace1363fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bea5f0-f0dc-4e01-b04f-136ace1363fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f48b7d6-e73f-4c93-b179-1e7a8de929fe', 'volume_name': 'volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144b9b4b-18dc-45d2-93a5-fe10e5ce89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144b9b4b-18dc-45d2-93a5-fe10e5ce89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f84c5a-63c4-4f3d-a0f4-6eedb1518f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:47 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume 2f48b7d6-e73f-4c93-b179-1e7a8de929fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe', 'volume_size': 1}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-62827481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f48b7d6-e73f-4c93-b179-1e7a8de929fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:47Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Creating volume 2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:47 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:47 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe 1073741824
Sep 23 00:23:47 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:47 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe 1073741824" returned: 0 in 0.578s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:47 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:23:47 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "cinder-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "cinder-quobyte-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Deleting offline snapshot 9625b2c1-0dda-4d9f-9d45-8d2116c07a4e of volume 5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:23:48 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] snapshot_file for this snap is: volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.372s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da7927-bf8b-47a9-b5b2-39424adc0c07]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f84c5a-63c4-4f3d-a0f4-6eedb1518f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f7c9a5-1961-4b68-88f1-a5174cb05305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:48 devstack sudo[98909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e
Sep 23 00:23:48 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:48 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Volume volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe (2f48b7d6-e73f-4c93-b179-1e7a8de929fe): created successfully
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f7c9a5-1961-4b68-88f1-a5174cb05305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (e7026eb1-696e-4dad-abd2-7c33d7b9a87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-90c87c56-3413-4da2-a06e-18078c770084 tempest-VolumesSnapshotTestJSON-1639239918 None] Created volume successfully.
Sep 23 00:23:48 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" returned: 0 in 0.412s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17f59ab-d3f3-4570-9eb0-ecf7c98a7dec]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:48 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b
Sep 23 00:23:48 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:49 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" returned: 0 in 0.495s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:49 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e
Sep 23 00:23:49 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Creating offline snapshot da09fb23-a4e1-4099-8c84-94257fddff05 of volume 2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a013414f-bf00-4063-b6be-74cb67169df5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:49 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" returned: 0 in 0.483s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:49 devstack sudo[98928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e
Sep 23 00:23:49 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:49 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:23:49 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:49 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b.9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" returned: 0 in 0.392s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e" released by "_delete_snapshot" :: held 1.950s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:50 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" released by "delete_snapshot" :: held 1.983s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.588s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:50 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 1G
Sep 23 00:23:50 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Created reservations ['b77c89e0-ed95-42f9-b11c-d1bf102b9951', 'd2546434-e854-4939-b72d-99e8aa5561e2', '5dc4f135-52f5-44a6-82b8-fa6da53df3b9', '9bdc8104-1514-4877-94fb-c34d79ded1c5'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Delete snapshot completed successfully.
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-371d76e5-25d3-46ea-bf40-09634b620db8 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-9625b2c1-0dda-4d9f-9d45-8d2116c07a4e-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:50 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 1G" returned: 0 in 0.552s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:50 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:23:50 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:50 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:50 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 is being set with open permissions: ugo+rw
Sep 23 00:23:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:50 devstack sudo[98946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:23:50 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:51 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.313s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:51 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info
Sep 23 00:23:51 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "cinder-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae6f3b4-dfad-4b75-96b0-654afb6b0c74]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:51 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b
Sep 23 00:23:51 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:51 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info" returned: 0 in 0.384s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:51 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info is being set with open permissions: ugo+rw
Sep 23 00:23:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:51 devstack sudo[98954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info
Sep 23 00:23:51 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:52 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:52 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.info" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:52 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b
Sep 23 00:23:52 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-eee8aa69-0276-4b67-81cd-99502d88557f tempest-VolumesSnapshotTestJSON-1639239918 None] Create snapshot completed successfully
Sep 23 00:23:52 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" returned: 0 in 0.343s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-quobyte-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b" released by "delete_volume" :: held 0.956s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Created reservations ['d7861cfc-afb9-4766-aa6e-066c3cc0daf8', 'fb7700ee-9daf-459f-baa3-a25a5a387773', '714a782a-f23e-45e7-8646-876e74e3fc03', '318291dc-eba1-4d9b-ade6-5178eaf6c003'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:52 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:52 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:53 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.358s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:53 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Deleted volume successfully.
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bccf3b3c-b8e1-4e75-b630-3d2e23ffa028 tempest-VolumesSnapshotNegativeTestJSON-1932811257 None] Lock "cinder-5c1eb021-1abe-4e8e-b9da-ef2eabbc256b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (75b8a417-dc0d-4961-a821-5493212f2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf172b1-bf51-49dc-8319-0a90a4c2a0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf172b1-bf51-49dc-8319-0a90a4c2a0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-906940183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc1bfec-0339-4fa5-a401-32acc8e22011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573bbef7d7e7495794e6e533a185d072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da09fb23-a4e1-4099-8c84-94257fddff05,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:54Z,use_quota=True,user_id='b772caee7c05456e89c5a39bcff89061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b188dd79-ecb8-4577-bff7-66528a1057a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b188dd79-ecb8-4577-bff7-66528a1057a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98db8f8-bb8a-4133-8220-9299b4eb1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98db8f8-bb8a-4133-8220-9299b4eb1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2cc1bfec-0339-4fa5-a401-32acc8e22011', 'volume_name': 'volume-2cc1bfec-0339-4fa5-a401-32acc8e22011', 'volume_size': 1, 'snapshot_id': 'da09fb23-a4e1-4099-8c84-94257fddff05'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355e471d-52f3-4e1c-a158-0dda4e8068ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355e471d-52f3-4e1c-a158-0dda4e8068ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fa61e9-e882-49a9-983d-acfd63261a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:23:53 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Volume 2cc1bfec-0339-4fa5-a401-32acc8e22011: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2cc1bfec-0339-4fa5-a401-32acc8e22011', 'volume_size': 1, 'snapshot_id': 'da09fb23-a4e1-4099-8c84-94257fddff05'}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05-2cc1bfec-0339-4fa5-a401-32acc8e22011" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05-2cc1bfec-0339-4fa5-a401-32acc8e22011" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Creating volume 2cc1bfec-0339-4fa5-a401-32acc8e22011 from snapshot da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] snapshot: da09fb23-a4e1-4099-8c84-94257fddff05, volume: 2cc1bfec-0339-4fa5-a401-32acc8e22011,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[60481df1-70c2-45b2-a0eb-e369c4dd7c35]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:54 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:23:54 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:54 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.764s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3aeca-7c68-43d6-b00a-1ebff8b6e91b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:23:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:55 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:23:55 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:55 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.696s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:23:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:23:55 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:23:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:55 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011
Sep 23 00:23:55 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:23:57 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:23:57 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:23:57 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.949s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:23:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:23:58 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:23:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:23:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:24:03 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=119,cinder:UPDATE=110,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:04 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=112,cinder:UPDATE=122,cinder:DELETE=9,cinder:INSERT=32 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:07 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011" returned: 0 in 12.198s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:07 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe, size 1024.00 MB, duration 12.20 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:24:07 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Converted 1024.00 MB image at 83.94 MB/s
Sep 23 00:24:07 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 is being set with open permissions: ugo+rw
Sep 23 00:24:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:07 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011
Sep 23 00:24:07 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:08 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" released by "_copy_volume_from_snapshot" :: held 14.372s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05-2cc1bfec-0339-4fa5-a401-32acc8e22011" released by "_create_volume_from_snapshot" :: held 14.533s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.569s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fa61e9-e882-49a9-983d-acfd63261a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc1bfec-0339-4fa5-a401-32acc8e22011', 'volume_size': 1, 'snapshot_id': 'da09fb23-a4e1-4099-8c84-94257fddff05'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1614e-4d8f-40f8-961a-8501efecd43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Volume volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 (2cc1bfec-0339-4fa5-a401-32acc8e22011): created successfully
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1614e-4d8f-40f8-961a-8501efecd43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Flow 'volume_create_manager' (75b8a417-dc0d-4961-a821-5493212f2f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8ef902b0-08b4-41df-a681-9e45fb85d9df tempest-VolumesSnapshotTestJSON-1639239918 None] Created volume successfully.
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-2cc1bfec-0339-4fa5-a401-32acc8e22011-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-2cc1bfec-0339-4fa5-a401-32acc8e22011-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" acquired by "delete_volume" :: waited 0.061s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20eae3e-8dc2-4500-9a89-091fb4933384]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:09 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011
Sep 23 00:24:09 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:10 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011" returned: 0 in 0.574s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:10 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011
Sep 23 00:24:10 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:10 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2cc1bfec-0339-4fa5-a401-32acc8e22011" returned: 0 in 0.514s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2cc1bfec-0339-4fa5-a401-32acc8e22011" released by "delete_volume" :: held 1.184s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['04341695-9abb-462f-849d-ecd79e9d853b', '647b1a5a-166b-4c89-8f7f-251334a6c9d7', '82959936-d723-4929-964c-b9cb7437b345', 'd8a02fcc-1843-44cc-9b49-670e812c4685'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:10 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:10 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:11 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.358s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Deleted volume successfully.
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4d65b8ce-392f-40b1-8f10-eea257b19c5a tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-2cc1bfec-0339-4fa5-a401-32acc8e22011-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-da09fb23-a4e1-4099-8c84-94257fddff05-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-da09fb23-a4e1-4099-8c84-94257fddff05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Deleting offline snapshot da09fb23-a4e1-4099-8c84-94257fddff05 of volume 2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] snapshot_file for this snap is: volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9d49c-3c50-4be2-937a-e2073782c983]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:12 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:24:12 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:12 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.752s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:24:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8539c91-1b9b-4782-aa11-21cd7a18dcb2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:12 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:24:12 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:13 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.718s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:13 devstack sudo[99109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:24:13 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:14 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.597s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:14 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05
Sep 23 00:24:14 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:14 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe.da09fb23-a4e1-4099-8c84-94257fddff05" returned: 0 in 0.483s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-da09fb23-a4e1-4099-8c84-94257fddff05" released by "_delete_snapshot" :: held 2.738s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" released by "delete_snapshot" :: held 2.790s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['dc57e954-570c-47bb-ace7-3d6c56414c8d', '98fbf438-10be-42a3-be94-c53ae11cd1f6', '481a67f7-5116-402f-99f0-7517b6a508a6', 'd9d2ab86-3f59-4107-8205-2ef07d5d6b56'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:14 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Delete snapshot completed successfully.
Sep 23 00:24:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-19574816-9a92-4219-9a79-1339d89209ef tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-da09fb23-a4e1-4099-8c84-94257fddff05-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-2f48b7d6-e73f-4c93-b179-1e7a8de929fe-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-2f48b7d6-e73f-4c93-b179-1e7a8de929fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" acquired by "delete_volume" :: waited 0.051s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76163d1-2645-4905-a2df-c38f80ddc526]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:15 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:24:15 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:16 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.735s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:16 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe
Sep 23 00:24:16 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:16 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-2f48b7d6-e73f-4c93-b179-1e7a8de929fe" released by "delete_volume" :: held 1.367s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['ff6ede8e-0859-4e52-b98f-f118d8b57c53', '96c0193b-1157-4a89-a916-dd38a69f6cf1', '1cf616ce-c0ee-4384-9ff8-e7a457784469', 'd3d4158c-0874-44dc-bedd-7ce201416930'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:17 devstack sudo[99162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:17 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:17 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Deleted volume successfully.
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a02b361e-826d-413d-badd-f017e546fc76 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-2f48b7d6-e73f-4c93-b179-1e7a8de929fe-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-6d9531cf-551c-4e07-9c96-483824cb2f7b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-6d9531cf-551c-4e07-9c96-483824cb2f7b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c55d7b6-e5e8-48ac-8e8f-42d94e5f58b0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:18 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b
Sep 23 00:24:18 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:18 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b" returned: 0 in 0.554s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:18 devstack sudo[99177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b
Sep 23 00:24:18 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:19 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6d9531cf-551c-4e07-9c96-483824cb2f7b" returned: 0 in 0.363s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-quobyte-6d9531cf-551c-4e07-9c96-483824cb2f7b" released by "delete_volume" :: held 1.058s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Created reservations ['e09fff1c-f2b6-4db1-8b2a-fc30733266d0', '83e1ad60-9ef1-4389-9335-0630428a063b', '323b0713-4cf9-418d-bd2b-cced1aa1ee7b', '2fb02e63-add6-4a83-ba19-d757ac894957'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:19 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:19 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:19 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.310s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Deleted volume successfully.
Sep 23 00:24:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a01d6357-9900-448f-b67c-8770b6df2df5 tempest-VolumesSnapshotTestJSON-1639239918 None] Lock "cinder-6d9531cf-551c-4e07-9c96-483824cb2f7b-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=22,cinder:UPDATE=36,cinder:INSERT=10 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=28,cinder:INSERT=7,cinder:SELECT=22,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (aac66ec1-bfe5-4e92-9778-ba20533aebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccbdfe-2e60-4562-9e0a-e23014bc6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccbdfe-2e60-4562-9e0a-e23014bc6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-242512664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50636d4-c0e3-4847-ba69-8a22c74e9569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:30Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7522d0f1-9ea1-4639-9f2c-f83962cd38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7522d0f1-9ea1-4639-9f2c-f83962cd38ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a214ab-722c-459b-b414-773cfe734bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a214ab-722c-459b-b414-773cfe734bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50636d4-c0e3-4847-ba69-8a22c74e9569', 'volume_name': 'volume-d50636d4-c0e3-4847-ba69-8a22c74e9569', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e326c4-a0f6-4952-8d2b-00d1e3fc6bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e326c4-a0f6-4952-8d2b-00d1e3fc6bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f648ee-cb4b-480e-8485-1af7a87b07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Volume d50636d4-c0e3-4847-ba69-8a22c74e9569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50636d4-c0e3-4847-ba69-8a22c74e9569', 'volume_size': 1}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-242512664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50636d4-c0e3-4847-ba69-8a22c74e9569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ffd6862eda442c8375077a1c1c95d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:30Z,use_quota=True,user_id='9a8ad126bc84475e9d42644fa42db3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Creating volume d50636d4-c0e3-4847-ba69-8a22c74e9569 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:30 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:30 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 1073741824
Sep 23 00:24:30 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:30 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 1073741824" returned: 0 in 0.807s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:30 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569
Sep 23 00:24:30 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:31 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569" returned: 0 in 0.402s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f648ee-cb4b-480e-8485-1af7a87b07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50636d4-c0e3-4847-ba69-8a22c74e9569', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd2304e-4e27-4af6-b9ac-38151e71ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:31 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Volume volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 (d50636d4-c0e3-4847-ba69-8a22c74e9569): created successfully
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd2304e-4e27-4af6-b9ac-38151e71ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Flow 'volume_create_manager' (aac66ec1-bfe5-4e92-9778-ba20533aebfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-54a691a3-1945-42b8-acbf-49e6da07e25e tempest-AttachVolumeNegativeTest-768989548 None] Created volume successfully.
Sep 23 00:24:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Flow 'volume_create_manager' (f1b79c23-1ed6-4ba0-849b-69ed37fd8d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6de117-dd70-4d01-882a-be5de8fe9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6de117-dd70-4d01-882a-be5de8fe9bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-248641695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e716af1-a588-40be-8be1-db39632b20fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ecb20413ea46bbabaa3f797e1c32d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:33Z,use_quota=True,user_id='199b429456d047c09ecf9eb2314e55a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e4d897-686f-4ece-b248-df6b84cf8f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e4d897-686f-4ece-b248-df6b84cf8f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5ebb60-9f80-4549-a209-f22325f7f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5ebb60-9f80-4549-a209-f22325f7f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e716af1-a588-40be-8be1-db39632b20fc', 'volume_name': 'volume-3e716af1-a588-40be-8be1-db39632b20fc', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f50530a-7c75-43e5-9e03-ffbb322bbf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f50530a-7c75-43e5-9e03-ffbb322bbf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cede9fb3-97c7-4176-bc61-5fd445aed96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume 3e716af1-a588-40be-8be1-db39632b20fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e716af1-a588-40be-8be1-db39632b20fc', 'volume_size': 1}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-248641695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e716af1-a588-40be-8be1-db39632b20fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ecb20413ea46bbabaa3f797e1c32d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:33Z,use_quota=True,user_id='199b429456d047c09ecf9eb2314e55a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Creating volume 3e716af1-a588-40be-8be1-db39632b20fc {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:33 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:33 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc 1073741824
Sep 23 00:24:33 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e1186978-9fe6-4f2e-8cf8-07afe547b5e1 req-1e4e954b-61bd-4658-87b4-f79fe58e55cb tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Flow 'volume_create_manager' (c6c338bc-fe9a-4dbe-8f84-e3bdf5f979cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d64cf1-3773-47c5-b50b-17b598e1b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d64cf1-3773-47c5-b50b-17b598e1b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1932790283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51e6abe-244b-4a99-b9b5-7cb788d446ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ecb20413ea46bbabaa3f797e1c32d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:34Z,use_quota=True,user_id='199b429456d047c09ecf9eb2314e55a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007d8f4-fe15-45ca-b461-870858c37837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007d8f4-fe15-45ca-b461-870858c37837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377d28c0-52d7-4ec7-a787-127071b2eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377d28c0-52d7-4ec7-a787-127071b2eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51e6abe-244b-4a99-b9b5-7cb788d446ae', 'volume_name': 'volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe210a38-a4ef-4ad2-937f-ba26f3917c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe210a38-a4ef-4ad2-937f-ba26f3917c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa627c-90df-4b9b-922f-efd9103fb108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume c51e6abe-244b-4a99-b9b5-7cb788d446ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae', 'volume_size': 1}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:33 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc 1073741824" returned: 0 in 0.801s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:34 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc
Sep 23 00:24:34 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:34 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc" returned: 0 in 0.357s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e1186978-9fe6-4f2e-8cf8-07afe547b5e1 req-1e4e954b-61bd-4658-87b4-f79fe58e55cb tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.115s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cede9fb3-97c7-4176-bc61-5fd445aed96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e716af1-a588-40be-8be1-db39632b20fc', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b75c7a-3277-4676-85ff-8c878c4a629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e1186978-9fe6-4f2e-8cf8-07afe547b5e1 req-1e4e954b-61bd-4658-87b4-f79fe58e55cb tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1932790283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51e6abe-244b-4a99-b9b5-7cb788d446ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ecb20413ea46bbabaa3f797e1c32d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:34Z,use_quota=True,user_id='199b429456d047c09ecf9eb2314e55a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Creating volume c51e6abe-244b-4a99-b9b5-7cb788d446ae {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:24:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume volume-3e716af1-a588-40be-8be1-db39632b20fc (3e716af1-a588-40be-8be1-db39632b20fc): created successfully
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b75c7a-3277-4676-85ff-8c878c4a629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Flow 'volume_create_manager' (f1b79c23-1ed6-4ba0-849b-69ed37fd8d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:34 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae 1073741824
Sep 23 00:24:34 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2ef2184a-6bcd-4ae2-b1dc-fb0974d6b2a8 tempest-TestServerVolumeAttachmentScenario-168575223 None] Created volume successfully.
Sep 23 00:24:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-e1186978-9fe6-4f2e-8cf8-07afe547b5e1 req-1e4e954b-61bd-4658-87b4-f79fe58e55cb tempest-AttachVolumeNegativeTest-768989548 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-d50636d4-c0e3-4847-ba69-8a22c74e9569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce01095c-058a-4e79-987a-827a8e599b2c', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:24:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-e1186978-9fe6-4f2e-8cf8-07afe547b5e1 req-1e4e954b-61bd-4658-87b4-f79fe58e55cb tempest-AttachVolumeNegativeTest-768989548 None] attachment_update completed successfully.
Sep 23 00:24:35 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae 1073741824" returned: 0 in 1.018s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:35 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae
Sep 23 00:24:35 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:35 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa627c-90df-4b9b-922f-efd9103fb108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cbd38a-6d3b-401c-8b60-e0214ac5102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:24:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Volume volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae (c51e6abe-244b-4a99-b9b5-7cb788d446ae): created successfully
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cbd38a-6d3b-401c-8b60-e0214ac5102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:24:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Flow 'volume_create_manager' (c6c338bc-fe9a-4dbe-8f84-e3bdf5f979cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:24:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-df087ecd-3433-45cd-9bc7-713a9e12893b tempest-TestServerVolumeAttachmentScenario-168575223 None] Created volume successfully.
Sep 23 00:24:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7256b8fe-fbe2-4d19-829e-81a6c3ae2588 req-82d0e7c0-4ca4-4465-bcca-a0addbaee9c9 tempest-AttachVolumeNegativeTest-768989548 None] Terminate volume connection completed successfully.
Sep 23 00:24:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7256b8fe-fbe2-4d19-829e-81a6c3ae2588 req-82d0e7c0-4ca4-4465-bcca-a0addbaee9c9 tempest-AttachVolumeNegativeTest-768989548 None] Deleting attachment ce01095c-058a-4e79-987a-827a8e599b2c. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:24:46 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=10,cinder:SELECT=13,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:47 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-d50636d4-c0e3-4847-ba69-8a22c74e9569-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-d50636d4-c0e3-4847-ba69-8a22c74e9569-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-quobyte-d50636d4-c0e3-4847-ba69-8a22c74e9569" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-d50636d4-c0e3-4847-ba69-8a22c74e9569" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c95eb0-ab65-4c7b-9606-57babba7d7c2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:50 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569
Sep 23 00:24:50 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:50 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569" returned: 0 in 0.921s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:50 devstack sudo[99827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569
Sep 23 00:24:50 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:51 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d50636d4-c0e3-4847-ba69-8a22c74e9569" returned: 0 in 0.583s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-d50636d4-c0e3-4847-ba69-8a22c74e9569" released by "delete_volume" :: held 1.620s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Created reservations ['fe76b056-79db-46b2-8428-1fdeb7cd068d', '77fa3ef1-7e13-4f35-9e2f-8ec8b2ad8b1d', '8d79a37a-a6d2-4cb9-baa6-b93bfd6a3243', '7ce5f97a-c9f7-422d-a174-9905c496e8be'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:51 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:51 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:52 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.805s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Deleted volume successfully.
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-842c8ce9-d358-48ec-9421-74c03b7c1fa3 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-d50636d4-c0e3-4847-ba69-8a22c74e9569-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-7501975a-757a-4b99-903a-32fc0be43178-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-7501975a-757a-4b99-903a-32fc0be43178-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-quobyte-7501975a-757a-4b99-903a-32fc0be43178" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-7501975a-757a-4b99-903a-32fc0be43178" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211ea0e-e886-4c51-81ed-d1aa21b98512]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:53 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178
Sep 23 00:24:53 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:53 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178" returned: 0 in 0.668s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:53 devstack sudo[99848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178
Sep 23 00:24:53 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:53 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7501975a-757a-4b99-903a-32fc0be43178" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-7501975a-757a-4b99-903a-32fc0be43178" released by "delete_volume" :: held 1.212s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Created reservations ['d0a7a727-950d-488d-a37b-32c7e08fc8ad', 'b5ffe9b5-bdf7-49c6-89d9-c75eb6cc83ab', '620313d7-a7fb-4a5d-83a8-fba774f63346', '04d9da90-8475-41ec-94b3-b3918f16a4e5'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:54 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:54 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:54 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.369s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Deleted volume successfully.
Sep 23 00:24:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b1caf175-7b7a-4b2a-ab30-7243f71e9a1e tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-7501975a-757a-4b99-903a-32fc0be43178-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-2fbd7840-5ff7-4025-b4a6-0b981b0dd105-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-2fbd7840-5ff7-4025-b4a6-0b981b0dd105-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "cinder-quobyte-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" acquired by "delete_volume" :: waited 0.052s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600e054-6700-4158-9be8-51a21e0b4182]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:24:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:55 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105
Sep 23 00:24:55 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:56 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:56 devstack sudo[99861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105
Sep 23 00:24:56 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:56 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" returned: 0 in 0.427s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-quobyte-2fbd7840-5ff7-4025-b4a6-0b981b0dd105" released by "delete_volume" :: held 1.205s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:24:56 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Created reservations ['109b832a-9bef-4c2c-87dc-5b248b34e14b', '4e299f97-65f8-4101-82fd-44ba3c5970bc', '9d816849-9f59-401e-a112-d81815c5ad15', '1fdfb774-0625-48d0-a8b3-ed2883aa509b'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:57 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:57 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:24:57 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:24:57 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:24:57 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.507s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:24:57 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.456s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:24:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Deleted volume successfully.
Sep 23 00:24:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1fddaa6e-fc88-4d1d-93c1-ae1697cbdc88 tempest-AttachVolumeNegativeTest-768989548 None] Lock "cinder-2fbd7840-5ff7-4025-b4a6-0b981b0dd105-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:07 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:25:07 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=21,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:25:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7ac28d64-9d0a-43ae-b8a7-5f60d9057e71 req-f6409c22-fe3d-4d5c-86f5-b12e465cbdbe tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7ac28d64-9d0a-43ae-b8a7-5f60d9057e71 req-f6409c22-fe3d-4d5c-86f5-b12e465cbdbe tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-7ac28d64-9d0a-43ae-b8a7-5f60d9057e71 req-f6409c22-fe3d-4d5c-86f5-b12e465cbdbe tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7ac28d64-9d0a-43ae-b8a7-5f60d9057e71 req-f6409c22-fe3d-4d5c-86f5-b12e465cbdbe tempest-TestServerVolumeAttachmentScenario-168575223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-3e716af1-a588-40be-8be1-db39632b20fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12968d38-f05c-4cd7-ad28-12512a3fa105', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:25:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7ac28d64-9d0a-43ae-b8a7-5f60d9057e71 req-f6409c22-fe3d-4d5c-86f5-b12e465cbdbe tempest-TestServerVolumeAttachmentScenario-168575223 None] attachment_update completed successfully.
Sep 23 00:25:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-46f40228-9f0b-4103-a02f-d3166b34f31f tempest-GroupsV314Test-717502909 None] Group tempest-GroupsV314Test-Group-1892683569: creating
Sep 23 00:25:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-46f40228-9f0b-4103-a02f-d3166b34f31f tempest-GroupsV314Test-717502909 None] Group tempest-GroupsV314Test-Group-1892683569: created successfully
Sep 23 00:25:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-46f40228-9f0b-4103-a02f-d3166b34f31f tempest-GroupsV314Test-717502909 None] Create group completed successfully.
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Flow 'volume_create_manager' (8f01e92d-8a01-4ac8-904d-a6b20e836e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe94569-0dcf-4cf8-b9a6-1cf87501c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe94569-0dcf-4cf8-b9a6-1cf87501c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656857170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3266b93d-361c-41fe-8e74-59cda03c8ca4,host='devstack@QuobyteHD#QuobyteHD',id=73b78d6d-e91b-494f-a588-3d4e997eae03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f964350aa4dbfa5b310f81eb400c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:24Z,use_quota=True,user_id='39b5e9e1b7b24d278e004dcd22c5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad880898-32f0-444e-bcf5-ff667e50e81f),volume_type_id=ad880898-32f0-444e-bcf5-ff667e50e81f)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fb144a-4c06-4015-8389-1d9e5123a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fb144a-4c06-4015-8389-1d9e5123a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da152fe-1906-4920-8073-2b2feb95c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da152fe-1906-4920-8073-2b2feb95c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b78d6d-e91b-494f-a588-3d4e997eae03', 'volume_name': 'volume-73b78d6d-e91b-494f-a588-3d4e997eae03', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717ef3e5-5ac0-42d3-aa99-bc2bbd44abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717ef3e5-5ac0-42d3-aa99-bc2bbd44abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a83ac0c-90e3-4cee-ba49-7bc1eba30839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:24 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Volume 73b78d6d-e91b-494f-a588-3d4e997eae03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b78d6d-e91b-494f-a588-3d4e997eae03', 'volume_size': 1}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3266b93d-361c-41fe-8e74-59cda03c8ca4,created_at=2026-09-22T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656857170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3266b93d-361c-41fe-8e74-59cda03c8ca4,host='devstack@QuobyteHD#QuobyteHD',id=73b78d6d-e91b-494f-a588-3d4e997eae03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f964350aa4dbfa5b310f81eb400c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:24Z,use_quota=True,user_id='39b5e9e1b7b24d278e004dcd22c5fe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad880898-32f0-444e-bcf5-ff667e50e81f),volume_type_id=ad880898-32f0-444e-bcf5-ff667e50e81f)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Creating volume 73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:24 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:25:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:24 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 1073741824
Sep 23 00:25:24 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Flow 'volume_create_manager' (92be7ddc-98e8-40c4-8c43-85e621fc034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332ee3bb-2398-41aa-9d90-02867063d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332ee3bb-2398-41aa-9d90-02867063d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-494135290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7e2060-1618-4ee2-bda9-daae7a444863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c121cae502544403b88882f4b533f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:25Z,use_quota=True,user_id='115e9396f90d4e2ea91183a3e5da2586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f04512c-98e2-4388-9af3-e2c9760066e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f04512c-98e2-4388-9af3-e2c9760066e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a958d2-765e-4817-bc5f-036156d897ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a958d2-765e-4817-bc5f-036156d897ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7e2060-1618-4ee2-bda9-daae7a444863', 'volume_name': 'volume-5b7e2060-1618-4ee2-bda9-daae7a444863', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a28592e-5740-4fbb-a7ac-55ae700d6f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a28592e-5740-4fbb-a7ac-55ae700d6f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc760aaa-1de5-4ead-a7ee-bed41bb0a38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Volume 5b7e2060-1618-4ee2-bda9-daae7a444863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7e2060-1618-4ee2-bda9-daae7a444863', 'volume_size': 1}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 1073741824" returned: 0 in 0.841s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:25 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:25 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:25 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-494135290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7e2060-1618-4ee2-bda9-daae7a444863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c121cae502544403b88882f4b533f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:25Z,use_quota=True,user_id='115e9396f90d4e2ea91183a3e5da2586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Creating volume 5b7e2060-1618-4ee2-bda9-daae7a444863 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:25:25 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a83ac0c-90e3-4cee-ba49-7bc1eba30839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b78d6d-e91b-494f-a588-3d4e997eae03', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 1073741824
Sep 23 00:25:25 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc9b15c-f6ee-4286-9b02-6b7dd381638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Volume volume-73b78d6d-e91b-494f-a588-3d4e997eae03 (73b78d6d-e91b-494f-a588-3d4e997eae03): created successfully
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc9b15c-f6ee-4286-9b02-6b7dd381638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Flow 'volume_create_manager' (8f01e92d-8a01-4ac8-904d-a6b20e836e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a2933fc9-50cb-4fb3-bf3d-716434a3a000 tempest-GroupsV314Test-717502909 None] Created volume successfully.
Sep 23 00:25:26 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 1073741824" returned: 0 in 0.820s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:26 devstack sudo[101109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863
Sep 23 00:25:26 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-3eff83dd-acf2-467d-863d-a0313fa77651 req-85b28b2a-f321-49f9-af72-b1da1c9749d2 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:27 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863" returned: 0 in 0.447s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.025s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:27 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Cloning volume 73b78d6d-e91b-494f-a588-3d4e997eae03 to volume 054bee7f-8956-42fd-9f5d-673bf095460b
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc760aaa-1de5-4ead-a7ee-bed41bb0a38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7e2060-1618-4ee2-bda9-daae7a444863', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dfb3e7-21d4-4ac5-822b-f89d5fa2caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:25:27 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Volume volume-5b7e2060-1618-4ee2-bda9-daae7a444863 (5b7e2060-1618-4ee2-bda9-daae7a444863): created successfully
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dfb3e7-21d4-4ac5-822b-f89d5fa2caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Flow 'volume_create_manager' (92be7ddc-98e8-40c4-8c43-85e621fc034e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Creating offline snapshot a3c90a2d-8b3e-4570-af84-c95386c12de7 of volume 73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:25:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-47380be2-0f94-4fc9-b4d8-fb5e5546b1c8 tempest-TestMinimumBasicScenario-1416438750 None] Created volume successfully.
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa725db-005f-420c-9ba9-4edc189c7b6e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:27 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:27 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:27 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.549s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:27 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 1G
Sep 23 00:25:27 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:28 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 1G" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b78d6d-e91b-494f-a588-3d4e997eae03 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:28 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b78d6d-e91b-494f-a588-3d4e997eae03 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:28 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-37bb4728-2801-4908-9579-82b94b7974f6 req-08527151-4c3f-4e94-8a5d-94275818d5bf tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:28 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b78d6d-e91b-494f-a588-3d4e997eae03 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:28 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:25:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:28 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:28 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:29 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:29 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info
Sep 23 00:25:29 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:29 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:29 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info
Sep 23 00:25:29 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:29 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.info" returned: 0 in 0.314s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Acquiring lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] snapshot: a3c90a2d-8b3e-4570-af84-c95386c12de7, volume: 054bee7f-8956-42fd-9f5d-673bf095460b,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d7225-e331-4991-9a6a-65b7bce5e83b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:29 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:29 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:30 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.406s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73b78d6d-e91b-494f-a588-3d4e997eae03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[18134b82-7769-4ab6-95ca-e9a2a3add7e6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:30 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:30 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:30 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.460s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:25:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:30 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b
Sep 23 00:25:30 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:38 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b" returned: 0 in 7.695s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:25:38 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Converted 1024.00 MB image at 133.06 MB/s
Sep 23 00:25:38 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b is being set with open permissions: ugo+rw: NotImplementedError
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:38 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b
Sep 23 00:25:38 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:38 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b" returned: 0 in 0.294s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" released by "_copy_volume_from_snapshot" :: held 8.945s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Acquiring lock "cinder-quobyte-a3c90a2d-8b3e-4570-af84-c95386c12de7" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-a3c90a2d-8b3e-4570-af84-c95386c12de7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Deleting offline snapshot a3c90a2d-8b3e-4570-af84-c95386c12de7 of volume 73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] snapshot_file for this snap is: volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe0c7b-850c-454b-8038-d9491fd52b34]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:38 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:38 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:25:39 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73b78d6d-e91b-494f-a588-3d4e997eae03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb387e8-92d6-40ef-9390-574bf7cd12f5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:39 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:39 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:39 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.595s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:39 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:39 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:40 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.387s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:40 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7
Sep 23 00:25:40 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:40 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03.a3c90a2d-8b3e-4570-af84-c95386c12de7" returned: 0 in 0.312s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-a3c90a2d-8b3e-4570-af84-c95386c12de7" released by "_delete_snapshot" :: held 1.844s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.479s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-3eff83dd-acf2-467d-863d-a0313fa77651 req-85b28b2a-f321-49f9-af72-b1da1c9749d2 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.498s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-3eff83dd-acf2-467d-863d-a0313fa77651 req-85b28b2a-f321-49f9-af72-b1da1c9749d2 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-37bb4728-2801-4908-9579-82b94b7974f6 req-08527151-4c3f-4e94-8a5d-94275818d5bf tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.992s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-37bb4728-2801-4908-9579-82b94b7974f6 req-08527151-4c3f-4e94-8a5d-94275818d5bf tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-3eff83dd-acf2-467d-863d-a0313fa77651 req-85b28b2a-f321-49f9-af72-b1da1c9749d2 tempest-TestServerVolumeAttachmentScenario-168575223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2058ba3-c99f-40c4-b2d9-78cf96fffb37', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:25:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-37bb4728-2801-4908-9579-82b94b7974f6 req-08527151-4c3f-4e94-8a5d-94275818d5bf tempest-TestMinimumBasicScenario-1416438750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-5b7e2060-1618-4ee2-bda9-daae7a444863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8a91a0b-2c1c-430a-958b-52cec7a13e5f', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:25:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1a8f3880-0f35-43b1-8c37-0827b036865d tempest-GroupsV314Test-717502909 None] Create group from source-group-3266b93d-361c-41fe-8e74-59cda03c8ca4 completed successfully.
Sep 23 00:25:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-3eff83dd-acf2-467d-863d-a0313fa77651 req-85b28b2a-f321-49f9-af72-b1da1c9749d2 tempest-TestServerVolumeAttachmentScenario-168575223 None] attachment_update completed successfully.
Sep 23 00:25:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-37bb4728-2801-4908-9579-82b94b7974f6 req-08527151-4c3f-4e94-8a5d-94275818d5bf tempest-TestMinimumBasicScenario-1416438750 None] attachment_update completed successfully.
Sep 23 00:25:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Acquiring lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50bffbb-bd92-4e9e-b833-2de644be10f9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:41 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b
Sep 23 00:25:41 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:42 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b" returned: 0 in 0.443s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:42 devstack sudo[101273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b
Sep 23 00:25:42 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:42 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-054bee7f-8956-42fd-9f5d-673bf095460b" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-054bee7f-8956-42fd-9f5d-673bf095460b" released by "delete_volume" :: held 0.957s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Created reservations ['886d79f0-6c11-4b12-a228-cfd0e1071116'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:42 devstack cinder-volume[86631]: WARNING cinder.quota [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1031054166 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1031054166, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:42 devstack cinder-volume[86631]: WARNING cinder.quota [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1031054166 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1031054166, it is now deprecated. Please use the default quota class for default quota.
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Created reservations ['10438c1b-6446-42c2-a246-de2cdc97b0c8', 'bb32211d-fe04-4fba-bfee-a4d5e50fc691', '1026d461-a9af-4a85-8db0-93e804557a57', '25a7abb4-181f-4d7c-a147-4bc51a87fbbc'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:43 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:25:43 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-7b8a392a-7e56-4373-9b88-c07a37cdedda req-cb97422d-8711-4fde-8ce1-391ff517843a tempest-TestServerVolumeAttachmentScenario-168575223 None] Terminate volume connection completed successfully.
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-7b8a392a-7e56-4373-9b88-c07a37cdedda req-cb97422d-8711-4fde-8ce1-391ff517843a tempest-TestServerVolumeAttachmentScenario-168575223 None] Deleting attachment c2058ba3-c99f-40c4-b2d9-78cf96fffb37. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:25:43 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.418s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:43 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5c2f6fa2-8b7a-415c-8663-bfa4ea9da7cd tempest-GroupsV314Test-717502909 None] Delete group completed successfully.
Sep 23 00:25:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Acquiring lock "cinder-quobyte-73b78d6d-e91b-494f-a588-3d4e997eae03" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-73b78d6d-e91b-494f-a588-3d4e997eae03" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617f372-03f6-46eb-af0c-f454167d6df5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-27699e1c-a32d-4b05-8b52-74c66bd6b209 req-1999fb1b-6d02-41ca-9be4-53f52150d7dc tempest-TestServerVolumeAttachmentScenario-168575223 None] Terminate volume connection completed successfully.
Sep 23 00:25:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-27699e1c-a32d-4b05-8b52-74c66bd6b209 req-1999fb1b-6d02-41ca-9be4-53f52150d7dc tempest-TestServerVolumeAttachmentScenario-168575223 None] Deleting attachment 12968d38-f05c-4cd7-ad28-12512a3fa105. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:25:45 devstack sudo[101322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:45 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:45 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.659s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:45 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03
Sep 23 00:25:45 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:45 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-73b78d6d-e91b-494f-a588-3d4e997eae03" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Lock "cinder-quobyte-73b78d6d-e91b-494f-a588-3d4e997eae03" released by "delete_volume" :: held 1.080s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:45 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Created reservations ['fc232094-f89d-4a98-b465-30c74e488d5d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Created reservations ['7fdf051e-1c0a-4272-b7aa-9eac66285c03', '44c4889f-3657-40b9-8055-cb1aed13ea94', '09304637-0d0e-469e-b08b-bcf4a3a063b8', '90036cb9-5f70-4e1a-8616-77c8d5654058'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:46 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:25:46 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:46 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.453s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:46 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-10eba0b2-64f2-4592-8bc0-c72fd0ba0644 tempest-GroupsV314Test-717502909 None] Delete group completed successfully.
Sep 23 00:25:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "cinder-c51e6abe-244b-4a99-b9b5-7cb788d446ae-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-c51e6abe-244b-4a99-b9b5-7cb788d446ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "cinder-quobyte-c51e6abe-244b-4a99-b9b5-7cb788d446ae" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-quobyte-c51e6abe-244b-4a99-b9b5-7cb788d446ae" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bd7f31-56b7-42df-be3e-2e7e2d2d3b08]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:53 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae
Sep 23 00:25:53 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:53 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae" returned: 0 in 0.583s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:53 devstack sudo[101375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae
Sep 23 00:25:53 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:53 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c51e6abe-244b-4a99-b9b5-7cb788d446ae" returned: 0 in 0.322s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-quobyte-c51e6abe-244b-4a99-b9b5-7cb788d446ae" released by "delete_volume" :: held 0.980s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Created reservations ['0281e377-5950-433a-aecf-6941e9f1c37d', '44f6d2f1-b999-4d81-845a-eaa08d6d97dd', 'dc8991dd-f0e7-47ce-878e-fad5573c7efc', 'cd22edd8-2780-45d3-b5cd-0e5467478dc2'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:54 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:25:54 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:54 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.335s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Deleted volume successfully.
Sep 23 00:25:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-50cae321-9ac6-4c21-8e0e-11499c1de39e tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-c51e6abe-244b-4a99-b9b5-7cb788d446ae-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "cinder-3e716af1-a588-40be-8be1-db39632b20fc-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-3e716af1-a588-40be-8be1-db39632b20fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "cinder-quobyte-3e716af1-a588-40be-8be1-db39632b20fc" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-quobyte-3e716af1-a588-40be-8be1-db39632b20fc" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd713df5-2e18-4f8a-9e97-112ed412410c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:55 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc
Sep 23 00:25:55 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:55 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc" returned: 0 in 0.477s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:55 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc
Sep 23 00:25:55 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:56 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e716af1-a588-40be-8be1-db39632b20fc" returned: 0 in 0.370s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-quobyte-3e716af1-a588-40be-8be1-db39632b20fc" released by "delete_volume" :: held 0.892s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Created reservations ['38eb7e30-de13-4fc8-9917-68e2716a0c33', 'a84c9322-b693-47c6-8c62-fb86014f0122', 'd14723be-b125-43d2-bf3a-bb0c85ba88fa', '49d8d71f-ae31-4bf7-ba5e-4398f855ff03'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:56 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:25:56 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:56 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Deleted volume successfully.
Sep 23 00:25:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-496cf258-da6f-4dae-b8f1-50e0669e62e0 tempest-TestServerVolumeAttachmentScenario-168575223 None] Lock "cinder-3e716af1-a588-40be-8be1-db39632b20fc-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:25:57 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:25:57 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:25:57 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.413s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:25:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Flow 'volume_create_manager' (4f52c3e5-4e51-45b9-b0d8-b3ba0513bf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e8709d-ddff-4dd8-ba36-b2dc798c6b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e8709d-ddff-4dd8-ba36-b2dc798c6b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1472182181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8a1816-4750-47e4-af20-fec3250fba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd98b9feabc34b6ead3377f8b921640e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:06Z,use_quota=True,user_id='58408404c2c747a1ba80d7cbbcc34229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b3b189-8b92-4d7c-991b-c7f4ec73d660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b3b189-8b92-4d7c-991b-c7f4ec73d660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e8f2fd-81fd-49dd-92f5-3616b798f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e8f2fd-81fd-49dd-92f5-3616b798f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8a1816-4750-47e4-af20-fec3250fba70', 'volume_name': 'volume-3d8a1816-4750-47e4-af20-fec3250fba70', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c7532b-2129-435a-bcc7-bf9080ca964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c7532b-2129-435a-bcc7-bf9080ca964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c249df-f886-445e-a6b4-358a99ea92e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Volume 3d8a1816-4750-47e4-af20-fec3250fba70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8a1816-4750-47e4-af20-fec3250fba70', 'volume_size': 1}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1472182181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8a1816-4750-47e4-af20-fec3250fba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd98b9feabc34b6ead3377f8b921640e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:06Z,use_quota=True,user_id='58408404c2c747a1ba80d7cbbcc34229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Creating volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:26:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:06 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 1073741824
Sep 23 00:26:06 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:07 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 1073741824" returned: 0 in 0.531s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:07 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70
Sep 23 00:26:07 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:07 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70" returned: 0 in 0.364s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=58,cinder:SELECT=61,cinder:INSERT=15,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c249df-f886-445e-a6b4-358a99ea92e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8a1816-4750-47e4-af20-fec3250fba70', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeab286-2bec-4b26-9934-abfc524153ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Volume volume-3d8a1816-4750-47e4-af20-fec3250fba70 (3d8a1816-4750-47e4-af20-fec3250fba70): created successfully
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeab286-2bec-4b26-9934-abfc524153ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Flow 'volume_create_manager' (4f52c3e5-4e51-45b9-b0d8-b3ba0513bf12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c1670006-56c5-4ae0-a846-c58c81e64c75 tempest-SnapshotsActionsTest-1392546751 None] Created volume successfully.
Sep 23 00:26:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Creating offline snapshot 5eceaeed-ad5c-469d-879e-cc5b21191f76 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:26:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f7db5f-17ef-4fe5-a146-0e4db3213df5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:08 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70
Sep 23 00:26:08 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:09 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:09 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 1G
Sep 23 00:26:09 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:09 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 1G" returned: 0 in 0.581s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:09 devstack sudo[101426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:09 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:10 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:10 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 is being set with open permissions: ugo+rw
Sep 23 00:26:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:10 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:10 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:10 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.357s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:10 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info
Sep 23 00:26:10 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:11 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info" returned: 0 in 0.412s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:11 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info is being set with open permissions: ugo+rw
Sep 23 00:26:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:11 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info
Sep 23 00:26:11 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:11 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.info" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-39e6610a-bb92-4fa9-b642-f8f3ceb4fc19 tempest-SnapshotsActionsTest-1392546751 None] Create snapshot completed successfully
Sep 23 00:26:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Creating offline snapshot 758e1ad1-3c02-4fde-bee4-b5b776e30a9b of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:26:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f3dbd-afb5-4d42-813b-2a425cbe35a6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:13 devstack sudo[101465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:13 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:13 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.648s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:13 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b 1G
Sep 23 00:26:13 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:14 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b 1G" returned: 0 in 0.688s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:14 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b
Sep 23 00:26:14 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:14 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b" returned: 0 in 0.487s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:14 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b is being set with open permissions: ugo+rw
Sep 23 00:26:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:14 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b
Sep 23 00:26:14 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:15 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-75dd153c-20f0-473b-ade6-293964361ec7 tempest-SnapshotsActionsTest-1392546751 None] Create snapshot completed successfully
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-758e1ad1-3c02-4fde-bee4-b5b776e30a9b-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-758e1ad1-3c02-4fde-bee4-b5b776e30a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-758e1ad1-3c02-4fde-bee4-b5b776e30a9b" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-758e1ad1-3c02-4fde-bee4-b5b776e30a9b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Deleting offline snapshot 758e1ad1-3c02-4fde-bee4-b5b776e30a9b of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] snapshot_file for this snap is: volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d5a66a-1f86-47da-b8af-57787a3594c9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:16 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b
Sep 23 00:26:16 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:17 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b" returned: 0 in 0.603s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8862a1da-54b5-4154-ae6c-fd779d48a635]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:17 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:17 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:17 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.456s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:17 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b
Sep 23 00:26:17 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:18 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:18 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b
Sep 23 00:26:18 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:18 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.758e1ad1-3c02-4fde-bee4-b5b776e30a9b" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-758e1ad1-3c02-4fde-bee4-b5b776e30a9b" released by "_delete_snapshot" :: held 2.151s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_snapshot" :: held 2.198s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Created reservations ['fc9276d3-eddf-4915-86a3-fed4a052574b', '6c564d2b-3523-46c5-a9e5-06c94cc67a38', '82aa8e3e-c6c5-4e43-b3a3-2317c6e60276', 'e927ebba-0ec6-4ae8-b194-c7432cc782fa'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Delete snapshot completed successfully.
Sep 23 00:26:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-278b3155-ca0e-47c7-8f6c-24be24ad1941 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-758e1ad1-3c02-4fde-bee4-b5b776e30a9b-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Creating offline snapshot aa2bf30d-6f2b-482b-ac88-5633d11e6886 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e116358-d045-4709-84f5-fdca02f55f2f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:20 devstack sudo[101508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:20 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:20 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.533s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:21 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 1G
Sep 23 00:26:21 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:21 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 1G" returned: 0 in 0.633s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:21 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886
Sep 23 00:26:21 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:22 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886" returned: 0 in 0.444s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 is being set with open permissions: ugo+rw
Sep 23 00:26:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:22 devstack sudo[101534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886
Sep 23 00:26:22 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:22 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886" returned: 0 in 0.380s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f86b0236-a707-4096-924e-88aa155391f5 tempest-SnapshotsActionsTest-1392546751 None] Create snapshot completed successfully
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-aa2bf30d-6f2b-482b-ac88-5633d11e6886-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-aa2bf30d-6f2b-482b-ac88-5633d11e6886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-aa2bf30d-6f2b-482b-ac88-5633d11e6886" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-aa2bf30d-6f2b-482b-ac88-5633d11e6886" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Deleting offline snapshot aa2bf30d-6f2b-482b-ac88-5633d11e6886 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] snapshot_file for this snap is: volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5eb46-bc22-4eee-8598-527dc4899cdc]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:23 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886
Sep 23 00:26:23 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:24 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886" returned: 0 in 0.575s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ad632-b12f-4e39-b122-a58da6513242]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:24 devstack sudo[101542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:24 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:24 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.568s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:25 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886
Sep 23 00:26:25 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:25 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:25 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886
Sep 23 00:26:25 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:25 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.aa2bf30d-6f2b-482b-ac88-5633d11e6886" returned: 0 in 0.383s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-aa2bf30d-6f2b-482b-ac88-5633d11e6886" released by "_delete_snapshot" :: held 2.192s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_snapshot" :: held 2.227s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:26 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Created reservations ['b10f4b53-87e1-438a-b6b1-b63c12a0de48', '99ee3f7d-0538-4b35-b82d-e996bcc176b9', '1361657d-2bfb-400b-bbf8-ac276ddde2a4', 'a7c64535-826e-48dc-9866-2ddc5f50e949'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Delete snapshot completed successfully.
Sep 23 00:26:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40479541-a6cc-4224-87ba-4a1ca77fd757 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-aa2bf30d-6f2b-482b-ac88-5633d11e6886-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Creating offline snapshot dbf83430-dac9-4752-8526-3960815cc38a of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea9b17-514d-4797-a751-3391f969ff36]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:27 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:27 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:27 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.465s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:27 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a 1G
Sep 23 00:26:27 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:28 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a 1G" returned: 0 in 0.718s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:28 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a
Sep 23 00:26:28 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:29 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a" returned: 0 in 0.395s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a is being set with open permissions: ugo+rw
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:29 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a
Sep 23 00:26:29 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:29 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a" returned: 0 in 0.268s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3172c836-c625-4337-bb5c-581daea11885 tempest-SnapshotsActionsTest-1392546751 None] Create snapshot completed successfully
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-dbf83430-dac9-4752-8526-3960815cc38a-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-dbf83430-dac9-4752-8526-3960815cc38a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-dbf83430-dac9-4752-8526-3960815cc38a" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-dbf83430-dac9-4752-8526-3960815cc38a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Deleting offline snapshot dbf83430-dac9-4752-8526-3960815cc38a of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] snapshot_file for this snap is: volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe07cfee-2ab4-4b55-9e62-c1bf33621b46]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:29 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a
Sep 23 00:26:29 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:30 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a" returned: 0 in 0.437s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd3af28-11ba-4f4c-baef-9f3920d8440e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:30 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:30 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:30 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.454s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:30 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a
Sep 23 00:26:30 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:31 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a" returned: 0 in 0.528s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:31 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a
Sep 23 00:26:31 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:31 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.dbf83430-dac9-4752-8526-3960815cc38a" returned: 0 in 0.331s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-dbf83430-dac9-4752-8526-3960815cc38a" released by "_delete_snapshot" :: held 1.869s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_snapshot" :: held 1.895s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Created reservations ['8386ffa6-c950-462e-bb78-9d3f8503660d', 'b3c29760-e29d-4203-9ce6-3d8c61dba88c', '95dcf46d-7d0b-410c-a2bf-cfefc27bed0f', '1b76d2a1-5186-4c11-b66e-c7faff03dc7e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Delete snapshot completed successfully.
Sep 23 00:26:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea9ecb34-1631-45d6-bd6a-819c033ba489 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-dbf83430-dac9-4752-8526-3960815cc38a-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Creating offline snapshot 57a62e75-64ff-4770-be1b-ee55668b4ac0 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c877ebf-26d5-4f8e-80ca-45890b6572ff]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:32 devstack sudo[101595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:32 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:32 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.516s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:32 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 1G
Sep 23 00:26:32 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:33 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 1G" returned: 0 in 0.721s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:33 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0
Sep 23 00:26:33 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:33 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:33 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 is being set with open permissions: ugo+rw
Sep 23 00:26:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:33 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0
Sep 23 00:26:33 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:34 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f399ce0c-0010-4944-b6cf-97bc6591638f tempest-SnapshotsActionsTest-1392546751 None] Create snapshot completed successfully
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-57a62e75-64ff-4770-be1b-ee55668b4ac0-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-57a62e75-64ff-4770-be1b-ee55668b4ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_snapshot" :: waited 0.092s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Acquiring lock "cinder-quobyte-57a62e75-64ff-4770-be1b-ee55668b4ac0" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-57a62e75-64ff-4770-be1b-ee55668b4ac0" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Deleting offline snapshot 57a62e75-64ff-4770-be1b-ee55668b4ac0 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] snapshot_file for this snap is: volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d3a6e2-999b-4050-9163-2c31e2758db6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:36 devstack sudo[101616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0
Sep 23 00:26:36 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:36 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0" returned: 0 in 0.506s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[89584e03-aff0-447f-9e5a-ee87fcb0c0ad]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:36 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:36 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:37 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.520s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:37 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0
Sep 23 00:26:37 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:37 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0" returned: 0 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:37 devstack sudo[101633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0
Sep 23 00:26:37 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:37 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.57a62e75-64ff-4770-be1b-ee55668b4ac0" returned: 0 in 0.353s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-57a62e75-64ff-4770-be1b-ee55668b4ac0" released by "_delete_snapshot" :: held 2.070s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_snapshot" :: held 2.133s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:38 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Created reservations ['876dcc96-4f3b-4513-af1f-eaacef74d1ff', 'bb650fb7-1ab2-4187-88d9-4b3cd40d1cfe', 'ee971e6c-edf4-4ed0-b85b-f67f97f84644', '443f9c5b-f9d7-4350-8882-bb6f46bbd27c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:38 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Delete snapshot completed successfully.
Sep 23 00:26:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-dd36501b-243c-44a3-95d1-e7a7a70d5d64 tempest-SnapshotsActionsTest-1909713652 None] Lock "cinder-57a62e75-64ff-4770-be1b-ee55668b4ac0-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "cinder-5eceaeed-ad5c-469d-879e-cc5b21191f76-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-5eceaeed-ad5c-469d-879e-cc5b21191f76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "cinder-quobyte-5eceaeed-ad5c-469d-879e-cc5b21191f76" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-5eceaeed-ad5c-469d-879e-cc5b21191f76" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Deleting offline snapshot 5eceaeed-ad5c-469d-879e-cc5b21191f76 of volume 3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] snapshot_file for this snap is: volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[236a17a2-b8f7-4823-8251-bab2e72834c7]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:39 devstack sudo[101643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:39 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:40 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.629s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8a1816-4750-47e4-af20-fec3250fba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864dcf5-1203-4afb-bdbd-28ef308dac2e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:40 devstack sudo[101648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70
Sep 23 00:26:40 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:40 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70" returned: 0 in 0.495s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:40 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:40 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:41 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.502s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:41 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76
Sep 23 00:26:41 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:41 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70.5eceaeed-ad5c-469d-879e-cc5b21191f76" returned: 0 in 0.379s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=67,cinder:SELECT=81,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-5eceaeed-ad5c-469d-879e-cc5b21191f76" released by "_delete_snapshot" :: held 2.201s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_snapshot" :: held 2.240s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Created reservations ['2a4062e5-e766-47da-a3d7-6bab592ac3ee', '81049a85-f4b5-473a-a3c6-ff3ec37a180e', 'b487f576-1fbd-4070-9163-6e3b0482ae6d', '9029d05d-e777-4494-91a3-870b748d3aa6'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Delete snapshot completed successfully.
Sep 23 00:26:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e1911182-e306-4833-aabe-1dde642281a5 tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-5eceaeed-ad5c-469d-879e-cc5b21191f76-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "cinder-3d8a1816-4750-47e4-af20-fec3250fba70-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-3d8a1816-4750-47e4-af20-fec3250fba70-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21af959-33be-4eba-960f-9911d08c907e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:43 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70
Sep 23 00:26:43 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:43 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70" returned: 0 in 0.495s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:43 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70
Sep 23 00:26:43 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:44 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d8a1816-4750-47e4-af20-fec3250fba70" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-quobyte-3d8a1816-4750-47e4-af20-fec3250fba70" released by "delete_volume" :: held 0.955s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Created reservations ['69ab6f4b-1767-4751-a053-d5b1ecc9255c', 'f7ca2201-9adc-4961-9dbb-e2248b3a0e64', '69452b4e-fb8c-4f96-830b-294eb635e8f4', '2df3f9fc-7e71-4375-a840-a91ff182660d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:44 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:26:44 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:44 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.402s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Deleted volume successfully.
Sep 23 00:26:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83256746-c3d8-4546-bd9c-09a54f48673a tempest-SnapshotsActionsTest-1392546751 None] Lock "cinder-3d8a1816-4750-47e4-af20-fec3250fba70-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Flow 'volume_create_manager' (e6ce6811-447f-4865-9985-b851359462a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96705540-7d8b-447c-b9f2-1aab7902bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96705540-7d8b-447c-b9f2-1aab7902bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-971542353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0260291-d84a-45bc-b50e-28d6e27b5505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0beb44e4a64386a8120d29bbf3160c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:52Z,use_quota=True,user_id='20d42efdad7240e0a61ca62b0d51c0bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3a3b16-7ce3-48cd-bc15-2685509107f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3a3b16-7ce3-48cd-bc15-2685509107f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb50c5-a333-42c6-b8ab-47623ea1ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:51 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb50c5-a333-42c6-b8ab-47623ea1ac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0260291-d84a-45bc-b50e-28d6e27b5505', 'volume_name': 'volume-e0260291-d84a-45bc-b50e-28d6e27b5505', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea0c5fa0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc20c5c-cdaa-4aea-ad31-6fa93d931ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc20c5c-cdaa-4aea-ad31-6fa93d931ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7002678e-8444-474c-9d9d-502d934d81ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:26:53 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Volume e0260291-d84a-45bc-b50e-28d6e27b5505: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0260291-d84a-45bc-b50e-28d6e27b5505', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea0c5fa0>}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Trying to clone e0260291-d84a-45bc-b50e-28d6e27b5505 from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:26:53 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[828625c0-830b-40d0-8302-df1f38acf7be]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:54 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD
Sep 23 00:26:54 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-f673fd3e-cc0e-4e4c-9ae8-42a8370f88d9 req-df508471-de14-42fd-85a4-0d00ce90fc4e tempest-TestMinimumBasicScenario-1416438750 None] Terminate volume connection completed successfully.
Sep 23 00:26:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-f673fd3e-cc0e-4e4c-9ae8-42a8370f88d9 req-df508471-de14-42fd-85a4-0d00ce90fc4e tempest-TestMinimumBasicScenario-1416438750 None] Deleting attachment c8a91a0b-2c1c-430a-958b-52cec7a13e5f. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:26:54 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD" returned: 0 in 0.677s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:54 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 is fetched for user 20d42efdad7240e0a61ca62b0d51c0bd. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:26:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2764694-9313-4d3d-ad02-c70ae3c4ca6f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:54 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD
Sep 23 00:26:54 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:55 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD" returned: 0 in 0.494s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-971542353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0260291-d84a-45bc-b50e-28d6e27b5505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0beb44e4a64386a8120d29bbf3160c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:52Z,use_quota=True,user_id='20d42efdad7240e0a61ca62b0d51c0bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Creating volume e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:26:55 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "cinder-5b7e2060-1618-4ee2-bda9-daae7a444863-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:55 devstack sudo[101735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1073741824
Sep 23 00:26:55 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "cinder-5b7e2060-1618-4ee2-bda9-daae7a444863-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "cinder-quobyte-5b7e2060-1618-4ee2-bda9-daae7a444863" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "cinder-quobyte-5b7e2060-1618-4ee2-bda9-daae7a444863" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3ee30-8ed8-45bf-ae2d-b7857eae6dc3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:55 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863
Sep 23 00:26:55 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:55 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1073741824" returned: 0 in 0.735s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:55 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863" returned: 0 in 0.536s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:55 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863
Sep 23 00:26:55 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:55 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505
Sep 23 00:26:55 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:56 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5b7e2060-1618-4ee2-bda9-daae7a444863" returned: 0 in 0.362s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "cinder-quobyte-5b7e2060-1618-4ee2-bda9-daae7a444863" released by "delete_volume" :: held 0.984s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:56 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505" returned: 0 in 0.369s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Attempting download of 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume e0260291-d84a-45bc-b50e-28d6e27b5505. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Created reservations ['2baadec8-3fb4-4058-b06d-80fa8a3eb87a', '3489592f-215a-423f-a8e9-f1366350461b', '491d080a-9334-40fc-9584-29d41cd18e37', 'e8c0066f-3764-46ec-9629-299960da4414'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb143be5-34ab-4635-971a-8fad715d2a53]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:56 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4
Sep 23 00:26:56 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:56 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:26:56 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:56 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4" returned: 0 in 0.473s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:56 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.394s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Deleted volume successfully.
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b52624fc-637f-4f7d-90ac-3fc1fd2dacfd tempest-TestMinimumBasicScenario-1416438750 None] Lock "cinder-5b7e2060-1618-4ee2-bda9-daae7a444863-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:26:57 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:26:57 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:57 devstack sudo[101760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4
Sep 23 00:26:57 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:57 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:26:57 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4" returned: 1 in 0.535s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_19tn4sa4' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25ad39-1281-4fa0-b616-6d960aadaf49]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:57 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD
Sep 23 00:26:57 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:26:57 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 was qcow2, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:26:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:26:58 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505
Sep 23 00:26:58 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:01 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505" returned: 0 in 3.275s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e86e9d0-c789-4bcb-9c7e-fb28de24dc76_w5f3qt_2devstack@QuobyteHD, size 112.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:27:01 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Converted 112.00 MB image at 34.16 MB/s
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:01 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1G
Sep 23 00:27:01 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:01 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 1G" returned: 0 in 0.532s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Downloaded image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}])) to volume e0260291-d84a-45bc-b50e-28d6e27b5505 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Temporary image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 for user 20d42efdad7240e0a61ca62b0d51c0bd is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Marking volume e0260291-d84a-45bc-b50e-28d6e27b5505 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Copying metadata from image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 to e0260291-d84a-45bc-b50e-28d6e27b5505. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Creating volume glance metadata for volume e0260291-d84a-45bc-b50e-28d6e27b5505 backed by image 6e86e9d0-c789-4bcb-9c7e-fb28de24dc76 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7002678e-8444-474c-9d9d-502d934d81ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0260291-d84a-45bc-b50e-28d6e27b5505', 'volume_size': 1, 'image_id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c494127452ef46cda40d0b0483b9f198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6e86e9d0-c789-4bcb-9c7e-fb28de24dc76', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e86e9d0-c789-4bcb-9c7e-fb28de24dc76/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea0c5fa0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7497c5-5122-4c02-a4c4-81e53405f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Volume volume-e0260291-d84a-45bc-b50e-28d6e27b5505 (e0260291-d84a-45bc-b50e-28d6e27b5505): created successfully
Sep 23 00:27:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7497c5-5122-4c02-a4c4-81e53405f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Flow 'volume_create_manager' (e6ce6811-447f-4865-9985-b851359462a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ff6478e1-eac2-4312-9c62-a49d3dc033a8 tempest-TestShelveInstance-1586391997 None] Created volume successfully.
Sep 23 00:27:08 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:DELETE=6,cinder:UPDATE=55,cinder:SELECT=48,cinder:INSERT=25 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:27:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8a47c8dc-493a-40e2-bb13-d830dc212d55 req-16f25cf5-b857-4204-bf95-04970aad34fd tempest-TestShelveInstance-1586391997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8a47c8dc-493a-40e2-bb13-d830dc212d55 req-16f25cf5-b857-4204-bf95-04970aad34fd tempest-TestShelveInstance-1586391997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8a47c8dc-493a-40e2-bb13-d830dc212d55 req-16f25cf5-b857-4204-bf95-04970aad34fd tempest-TestShelveInstance-1586391997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-8a47c8dc-493a-40e2-bb13-d830dc212d55 req-16f25cf5-b857-4204-bf95-04970aad34fd tempest-TestShelveInstance-1586391997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-e0260291-d84a-45bc-b50e-28d6e27b5505', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a97b1961-e88c-4cd4-8f07-99d39530d478', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:27:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-8a47c8dc-493a-40e2-bb13-d830dc212d55 req-16f25cf5-b857-4204-bf95-04970aad34fd tempest-TestShelveInstance-1586391997 None] attachment_update completed successfully.
Sep 23 00:27:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=1,cinder:SELECT=5 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:27:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=38,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (39340bc2-4697-40ff-bf66-125901e0c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348bbb8-7648-4c2a-a728-8a89009721d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348bbb8-7648-4c2a-a728-8a89009721d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699444832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f6ca39-b520-42f2-a79e-dd35f7e51622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:24Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f881e7-c3fc-4378-b24b-92a128c2c6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f881e7-c3fc-4378-b24b-92a128c2c6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec57c04-0c7b-4acf-96ac-65bc39f82f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec57c04-0c7b-4acf-96ac-65bc39f82f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f6ca39-b520-42f2-a79e-dd35f7e51622', 'volume_name': 'volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22627e-e1f1-4739-9882-fef39a405053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22627e-e1f1-4739-9882-fef39a405053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fa5187-4368-4fee-a735-153d231c3124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:23 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume d0f6ca39-b520-42f2-a79e-dd35f7e51622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622', 'volume_size': 1}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699444832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f6ca39-b520-42f2-a79e-dd35f7e51622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:24Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:23 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:23 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 1073741824
Sep 23 00:27:23 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Flow 'volume_create_manager' (5f502f63-0a4f-401d-b220-c9c9b8785460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963fe5a9-b552-4f2a-9bfa-17482f0233c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963fe5a9-b552-4f2a-9bfa-17482f0233c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-31312431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472aa46-5710-46b5-8336-ee0c7de3b8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890aafaff2aa4a39933e259eef84bda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='031feb11b6a34bb2827c186430ca728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd69d95-98fa-46d9-ad9a-a732a62107ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd69d95-98fa-46d9-ad9a-a732a62107ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db02f97-640b-4cac-bbce-aa86ddf3c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db02f97-640b-4cac-bbce-aa86ddf3c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9472aa46-5710-46b5-8336-ee0c7de3b8c4', 'volume_name': 'volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744ab91c-5568-4920-a858-ab15c2faa69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744ab91c-5568-4920-a858-ab15c2faa69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fb4c07-7f15-4a89-9ef9-27124bd52fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume 9472aa46-5710-46b5-8336-ee0c7de3b8c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4', 'volume_size': 1}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 1073741824" returned: 0 in 1.226s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:25 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622
Sep 23 00:27:25 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:25 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-31312431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9472aa46-5710-46b5-8336-ee0c7de3b8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890aafaff2aa4a39933e259eef84bda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='031feb11b6a34bb2827c186430ca728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Creating volume 9472aa46-5710-46b5-8336-ee0c7de3b8c4 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:25 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:25 devstack sudo[102319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 1073741824
Sep 23 00:27:25 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fa5187-4368-4fee-a735-153d231c3124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ee49f3-1bdb-485c-8058-4b91948cdf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 (d0f6ca39-b520-42f2-a79e-dd35f7e51622): created successfully
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ee49f3-1bdb-485c-8058-4b91948cdf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (39340bc2-4697-40ff-bf66-125901e0c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-63b2830c-0b78-4135-93d3-96f21aeca6c2 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:26 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 1073741824" returned: 0 in 0.836s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:26 devstack sudo[102325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4
Sep 23 00:27:26 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:26 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4" returned: 0 in 0.276s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.346s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fb4c07-7f15-4a89-9ef9-27124bd52fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e1630-5076-4d17-a390-acd317446918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating offline snapshot 07ade637-ac53-475f-a7ef-e30423cd608c of volume d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:27:26 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 (9472aa46-5710-46b5-8336-ee0c7de3b8c4): created successfully
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e1630-5076-4d17-a390-acd317446918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Flow 'volume_create_manager' (5f502f63-0a4f-401d-b220-c9c9b8785460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e64aea-65a4-4a18-a7c7-b274a641e22a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-010241d6-d319-4cd5-acef-9243e99385ce tempest-VolumeQuotasAdminTestJSON-838895039 None] Created volume successfully.
Sep 23 00:27:26 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622
Sep 23 00:27:26 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "cinder-9472aa46-5710-46b5-8336-ee0c7de3b8c4-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "cinder-9472aa46-5710-46b5-8336-ee0c7de3b8c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "cinder-quobyte-9472aa46-5710-46b5-8336-ee0c7de3b8c4" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "cinder-quobyte-9472aa46-5710-46b5-8336-ee0c7de3b8c4" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d2e9d-b4e1-4bf4-a9b0-1309ed33f0b3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:27 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622" returned: 0 in 0.521s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:27 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c 1G
Sep 23 00:27:27 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:27 devstack sudo[102334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4
Sep 23 00:27:27 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:27 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4" returned: 0 in 0.435s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:27 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4
Sep 23 00:27:27 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:27 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c 1G" returned: 0 in 0.577s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:27 devstack sudo[102347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c
Sep 23 00:27:27 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:28 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9472aa46-5710-46b5-8336-ee0c7de3b8c4" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "cinder-quobyte-9472aa46-5710-46b5-8336-ee0c7de3b8c4" released by "delete_volume" :: held 0.824s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Created reservations ['ab041934-9c04-44e0-b13c-a0f070b1bc5d', 'f265466d-a068-47e9-a4dc-467c022e81a1', 'af779ff4-cd22-46b2-893d-ea8e6b676c18', 'e82115c0-e1bd-47e7-9361-7d61028ed03f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:28 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:28 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:28 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c" returned: 0 in 0.455s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:28 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c is being set with open permissions: ugo+rw
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:28 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c
Sep 23 00:27:28 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:28 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.395s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Deleted volume successfully.
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ca803eb7-4e98-42d0-a740-3a00d232ffc7 tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "cinder-9472aa46-5710-46b5-8336-ee0c7de3b8c4-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:28 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c" returned: 0 in 0.352s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:28 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info
Sep 23 00:27:28 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:29 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info" returned: 0 in 0.338s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info is being set with open permissions: ugo+rw
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:29 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info
Sep 23 00:27:29 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Flow 'volume_create_manager' (441d2d0a-983a-49db-a287-fe0f88e5012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a9bcf7-5b5a-4184-a66a-f53eb3265d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a9bcf7-5b5a-4184-a66a-f53eb3265d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-652394074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd54fce-9d56-40c1-bf56-b54e4722043e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890aafaff2aa4a39933e259eef84bda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='031feb11b6a34bb2827c186430ca728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da8873-398b-440a-9839-a04594ac32f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da8873-398b-440a-9839-a04594ac32f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62df5fb-187e-4e6b-a9c0-8375e6c1a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62df5fb-187e-4e6b-a9c0-8375e6c1a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd54fce-9d56-40c1-bf56-b54e4722043e', 'volume_name': 'volume-ecd54fce-9d56-40c1-bf56-b54e4722043e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80c83a-bcd0-4301-b9f6-e7a52d43b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80c83a-bcd0-4301-b9f6-e7a52d43b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e62136d-8ce2-4b12-9979-635b243d933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:29 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume ecd54fce-9d56-40c1-bf56-b54e4722043e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd54fce-9d56-40c1-bf56-b54e4722043e', 'volume_size': 1}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:29 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.info" returned: 0 in 0.287s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.070s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-652394074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd54fce-9d56-40c1-bf56-b54e4722043e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890aafaff2aa4a39933e259eef84bda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='031feb11b6a34bb2827c186430ca728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Creating volume ecd54fce-9d56-40c1-bf56-b54e4722043e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:29 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:29 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e 1073741824
Sep 23 00:27:29 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-69346c4f-2a7f-4f42-999a-3a865b1fb870 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Create snapshot completed successfully
Sep 23 00:27:29 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e 1073741824" returned: 0 in 0.475s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:29 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e
Sep 23 00:27:29 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:30 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e" returned: 0 in 0.349s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e62136d-8ce2-4b12-9979-635b243d933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd54fce-9d56-40c1-bf56-b54e4722043e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017145-d55d-480b-833b-4dc94082f895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Volume volume-ecd54fce-9d56-40c1-bf56-b54e4722043e (ecd54fce-9d56-40c1-bf56-b54e4722043e): created successfully
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017145-d55d-480b-833b-4dc94082f895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Flow 'volume_create_manager' (441d2d0a-983a-49db-a287-fe0f88e5012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a9bec552-ed5a-40b1-b14b-8ba5fcb558aa tempest-VolumeQuotasAdminTestJSON-838895039 None] Created volume successfully.
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (a31e4af7-975f-43a3-8d44-ef9406492daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18cbd3d-a45d-4e31-8db8-fd5d732105cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18cbd3d-a45d-4e31-8db8-fd5d732105cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524876282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaeb177-dad4-42e9-958b-bb5bcd73f12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:31Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a5b56-631c-4f64-ad2d-6a9984c2f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321a5b56-631c-4f64-ad2d-6a9984c2f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cded69-c438-4550-95c9-d717ec1bd9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cded69-c438-4550-95c9-d717ec1bd9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfaeb177-dad4-42e9-958b-bb5bcd73f12a', 'volume_name': 'volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80d3834-2205-4d68-818d-f0502b31a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80d3834-2205-4d68-818d-f0502b31a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f972bcf8-c9da-4394-ae0e-120e3f1bff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume bfaeb177-dad4-42e9-958b-bb5bcd73f12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a', 'volume_size': 1}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524876282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaeb177-dad4-42e9-958b-bb5bcd73f12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:31Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume bfaeb177-dad4-42e9-958b-bb5bcd73f12a {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:31 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:31 devstack sudo[102374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a 1073741824
Sep 23 00:27:31 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (6832aea8-e0d0-4c14-a460-825f855f47a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7040fe87-b09a-4a70-b021-c13200b5787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7040fe87-b09a-4a70-b021-c13200b5787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761914526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fc88a8-dd74-44fb-92fd-2d503c7daf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:32Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14678b66-6c78-4f73-9a1c-b185a6e34ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14678b66-6c78-4f73-9a1c-b185a6e34ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060c6446-ad3d-4443-8a0e-8115363bdbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060c6446-ad3d-4443-8a0e-8115363bdbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03fc88a8-dd74-44fb-92fd-2d503c7daf15', 'volume_name': 'volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650e8716-63ff-4bfb-beee-7cf10ec593a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650e8716-63ff-4bfb-beee-7cf10ec593a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36920f43-0948-41e6-bfac-dca4875f8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume 03fc88a8-dd74-44fb-92fd-2d503c7daf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15', 'volume_size': 1}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:32 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a 1073741824" returned: 0 in 1.032s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:32 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a
Sep 23 00:27:32 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5e1dc0de-cc66-4cb5-922e-5538af702807 tempest-VolumeQuotasAdminTestJSON-717127236 None] Transfer volume completed successfully.
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (7a5bd303-3827-4a21-aa79-35472ebbe79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e833e2-f450-45b8-80b8-3af41862eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761914526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fc88a8-dd74-44fb-92fd-2d503c7daf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:32Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume 03fc88a8-dd74-44fb-92fd-2d503c7daf15 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:32 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e833e2-f450-45b8-80b8-3af41862eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134843641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941eaf45-ad8c-41ed-9689-687097791514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 1073741824
Sep 23 00:27:32 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491608b6-de77-4ec5-a918-1ff5a7e5dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491608b6-de77-4ec5-a918-1ff5a7e5dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7586a783-7437-425d-94a3-a7d8be75825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7586a783-7437-425d-94a3-a7d8be75825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941eaf45-ad8c-41ed-9689-687097791514', 'volume_name': 'volume-941eaf45-ad8c-41ed-9689-687097791514', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22a8032-8fa0-41e7-929c-0cebf83415d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22a8032-8fa0-41e7-929c-0cebf83415d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40511915-ce79-4e3b-b6c3-5b23eebeb54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume 941eaf45-ad8c-41ed-9689-687097791514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941eaf45-ad8c-41ed-9689-687097791514', 'volume_size': 1}
Sep 23 00:27:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f972bcf8-c9da-4394-ae0e-120e3f1bff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa6505-198c-42f3-85e0-c6c319bf5036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a (bfaeb177-dad4-42e9-958b-bb5bcd73f12a): created successfully
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa6505-198c-42f3-85e0-c6c319bf5036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (a31e4af7-975f-43a3-8d44-ef9406492daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4f78466f-ab62-43f2-af4c-3844ed87805c tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (6c8cbdb5-ade4-4afd-8eb8-796196ff66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1d4f79-4b82-4de0-913e-920f5289fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1d4f79-4b82-4de0-913e-920f5289fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535420288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11df7a5f-8921-4317-ae1b-558ebff10869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ff5aec-00d4-4a95-93a3-2dd55b44d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ff5aec-00d4-4a95-93a3-2dd55b44d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12a2703-1270-4f2f-b7a8-d3a8912b0045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12a2703-1270-4f2f-b7a8-d3a8912b0045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11df7a5f-8921-4317-ae1b-558ebff10869', 'volume_name': 'volume-11df7a5f-8921-4317-ae1b-558ebff10869', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee74b57-2f42-42b2-9d92-0a548f7fd9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee74b57-2f42-42b2-9d92-0a548f7fd9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb9e055-f397-4cfe-b092-ba9cca463027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume 11df7a5f-8921-4317-ae1b-558ebff10869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11df7a5f-8921-4317-ae1b-558ebff10869', 'volume_size': 1}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:33 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 1073741824" returned: 0 in 1.045s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:34 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15
Sep 23 00:27:34 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Acquiring lock "cinder-ecd54fce-9d56-40c1-bf56-b54e4722043e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "cinder-ecd54fce-9d56-40c1-bf56-b54e4722043e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Acquiring lock "cinder-quobyte-ecd54fce-9d56-40c1-bf56-b54e4722043e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (3c6be504-2dfd-446c-aa0d-7e840d04e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fbaa4-4f80-492c-8223-fef9b6461fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fbaa4-4f80-492c-8223-fef9b6461fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721299207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0fe460-731e-4fe4-af5d-28ba1a0380cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:34Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c56b58-745e-42cf-9015-d90e08879638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c56b58-745e-42cf-9015-d90e08879638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6f6722-7c6b-4dd2-b225-ff7cd077c249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6f6722-7c6b-4dd2-b225-ff7cd077c249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0fe460-731e-4fe4-af5d-28ba1a0380cd', 'volume_name': 'volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e39743-51ca-4be8-b28b-06f545c8fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e39743-51ca-4be8-b28b-06f545c8fa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829a0f44-dc19-4a6c-8604-66aaf92f67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume ca0fe460-731e-4fe4-af5d-28ba1a0380cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd', 'volume_size': 1}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "cinder-quobyte-ecd54fce-9d56-40c1-bf56-b54e4722043e" acquired by "delete_volume" :: waited 0.113s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea22689-7a7b-4492-bebf-cd4ac80a196a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:34 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134843641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941eaf45-ad8c-41ed-9689-687097791514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume 941eaf45-ad8c-41ed-9689-687097791514 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36920f43-0948-41e6-bfac-dca4875f8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2303b6-2937-438a-aa48-932efad332c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:34 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 1073741824
Sep 23 00:27:34 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 (03fc88a8-dd74-44fb-92fd-2d503c7daf15): created successfully
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2303b6-2937-438a-aa48-932efad332c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:34 devstack sudo[102392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e
Sep 23 00:27:34 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (6832aea8-e0d0-4c14-a460-825f855f47a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:34 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-831c9ea2-3731-43fc-a2a4-9f44a0c6b663 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:34 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e" returned: 0 in 0.443s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:34 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e
Sep 23 00:27:34 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:34 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 1073741824" returned: 0 in 0.576s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:35 devstack sudo[102429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514
Sep 23 00:27:35 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:35 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ecd54fce-9d56-40c1-bf56-b54e4722043e" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "cinder-quobyte-ecd54fce-9d56-40c1-bf56-b54e4722043e" released by "delete_volume" :: held 0.827s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Created reservations ['fcfe724b-4874-4050-9dbe-f4b5fb3afd09', 'cdb2298e-aa5c-420b-91a5-9857de7d89eb', 'dbffe351-cf44-499d-b1c6-ae9824d6fe2b', '44b1bba4-7922-41f4-a6a0-fd26b8e2dea4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:35 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:35 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:35 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535420288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11df7a5f-8921-4317-ae1b-558ebff10869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume 11df7a5f-8921-4317-ae1b-558ebff10869 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:35 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:35 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 1073741824
Sep 23 00:27:35 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40511915-ce79-4e3b-b6c3-5b23eebeb54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941eaf45-ad8c-41ed-9689-687097791514', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a739f2a4-41a0-4f0d-b0bf-210966a62bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-941eaf45-ad8c-41ed-9689-687097791514 (941eaf45-ad8c-41ed-9689-687097791514): created successfully
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a739f2a4-41a0-4f0d-b0bf-210966a62bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (7a5bd303-3827-4a21-aa79-35472ebbe79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7a719cb5-a047-421f-8cde-0e85f8ea3643 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:35 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.445s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Deleted volume successfully.
Sep 23 00:27:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ec23afa7-e927-4032-b6e6-e2b28be2d81e tempest-VolumeQuotasAdminTestJSON-101016871 None] Lock "cinder-ecd54fce-9d56-40c1-bf56-b54e4722043e-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:36 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 1073741824" returned: 0 in 0.790s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:36 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869
Sep 23 00:27:36 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:36 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869" returned: 0 in 0.409s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721299207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0fe460-731e-4fe4-af5d-28ba1a0380cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4711071ff145b195e15d78d2f9f457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:34Z,use_quota=True,user_id='2859081e0da54ad191380d4ecbcb4fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Creating volume ca0fe460-731e-4fe4-af5d-28ba1a0380cd {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:36 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:36 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd 1073741824
Sep 23 00:27:36 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb9e055-f397-4cfe-b092-ba9cca463027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11df7a5f-8921-4317-ae1b-558ebff10869', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b74c45-fec1-4eab-85d1-6b92827ea730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-11df7a5f-8921-4317-ae1b-558ebff10869 (11df7a5f-8921-4317-ae1b-558ebff10869): created successfully
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b74c45-fec1-4eab-85d1-6b92827ea730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (6c8cbdb5-ade4-4afd-8eb8-796196ff66fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5088f53c-aabd-4c6a-92a5-e5d05006ccfb tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:37 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd 1073741824" returned: 0 in 0.658s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:37 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd
Sep 23 00:27:37 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:37 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" returned: 0 in 0.352s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829a0f44-dc19-4a6c-8604-66aaf92f67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbaba1-5f65-48d5-aebf-74de6d03ac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Volume volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd (ca0fe460-731e-4fe4-af5d-28ba1a0380cd): created successfully
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafbaba1-5f65-48d5-aebf-74de6d03ac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Flow 'volume_create_manager' (3c6be504-2dfd-446c-aa0d-7e840d04e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c7f3e0fb-1c19-483d-b596-cb945e2aeb54 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created volume successfully.
Sep 23 00:27:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-ca0fe460-731e-4fe4-af5d-28ba1a0380cd-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-ca0fe460-731e-4fe4-af5d-28ba1a0380cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" acquired by "delete_volume" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa097b-0b31-4672-8f20-5e57d3ab392e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:39 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd
Sep 23 00:27:39 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:39 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" returned: 0 in 0.487s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:39 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd
Sep 23 00:27:39 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:39 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" returned: 0 in 0.312s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-ca0fe460-731e-4fe4-af5d-28ba1a0380cd" released by "delete_volume" :: held 0.864s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['54323fcc-5b55-455a-8fa9-fe61bd3728d6', 'e53fabac-80d9-49b0-89bb-d84f1a2c09fd', 'c810bb38-1288-4b3c-8a20-5f770db919e5', '923ee9a7-ecc3-41ad-bbea-73d5d70ca419'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:40 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:40 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-11df7a5f-8921-4317-ae1b-558ebff10869-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-11df7a5f-8921-4317-ae1b-558ebff10869-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-11df7a5f-8921-4317-ae1b-558ebff10869" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-11df7a5f-8921-4317-ae1b-558ebff10869" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2326878-095a-4a05-a469-fe3e61d9608d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:40 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:40 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869
Sep 23 00:27:40 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.368s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2cd700b-14f5-431c-b9ee-d89b36842985 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-ca0fe460-731e-4fe4-af5d-28ba1a0380cd-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:40 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869" returned: 0 in 0.476s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:40 devstack sudo[102495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869
Sep 23 00:27:40 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:41 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-11df7a5f-8921-4317-ae1b-558ebff10869" returned: 0 in 0.330s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-11df7a5f-8921-4317-ae1b-558ebff10869" released by "delete_volume" :: held 0.883s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['4920b2cd-5fff-4de8-adc2-bd09abdb4438', '959c5c24-8e2f-4366-9d8c-45718041b027', 'fe08c170-344f-428e-abfc-81a2050f2fc1', '95b8377a-485e-4e34-9087-55a12efc1e6c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:41 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:41 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-941eaf45-ad8c-41ed-9689-687097791514-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-941eaf45-ad8c-41ed-9689-687097791514-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-941eaf45-ad8c-41ed-9689-687097791514" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-941eaf45-ad8c-41ed-9689-687097791514" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[902f4a5c-f1e6-469e-b068-56a455169395]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:41 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-607368fb-ff92-4a28-a2f3-f8aeb358e518 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-11df7a5f-8921-4317-ae1b-558ebff10869-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:41 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514
Sep 23 00:27:41 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514" returned: 0 in 0.529s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[102506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514
Sep 23 00:27:42 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-941eaf45-ad8c-41ed-9689-687097791514" returned: 0 in 0.328s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-941eaf45-ad8c-41ed-9689-687097791514" released by "delete_volume" :: held 0.916s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['e4426cd9-06de-45b0-ade7-00059158b172', '2b1f1e57-dda0-438b-9024-7e611a60e905', '1eb7757d-b65a-43e9-969c-923971347689', '8f4155b7-3e54-4760-9b66-41e35f00d335'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:42 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-03fc88a8-dd74-44fb-92fd-2d503c7daf15-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-03fc88a8-dd74-44fb-92fd-2d503c7daf15-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-03fc88a8-dd74-44fb-92fd-2d503c7daf15" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-03fc88a8-dd74-44fb-92fd-2d503c7daf15" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b7358-78fa-4f0a-ad15-fa171216bb97]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:42 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97e72c0d-557a-4b35-85f1-cb20d073c8c3 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-941eaf45-ad8c-41ed-9689-687097791514-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:42 devstack sudo[102511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15
Sep 23 00:27:42 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:43 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15" returned: 0 in 0.510s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:43 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15
Sep 23 00:27:43 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:43 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-03fc88a8-dd74-44fb-92fd-2d503c7daf15" returned: 0 in 0.354s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-03fc88a8-dd74-44fb-92fd-2d503c7daf15" released by "delete_volume" :: held 0.947s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['20404882-2165-4243-910f-103b0de326e4', 'b6362a28-620b-4adf-8493-08c5a1731a71', 'dd6b16f3-e35f-439b-89e0-1c640ea4f03e', '51641d6a-1708-4a3c-9c9a-b62640211ae9'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:43 devstack sudo[102521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:43 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-bfaeb177-dad4-42e9-958b-bb5bcd73f12a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-bfaeb177-dad4-42e9-958b-bb5bcd73f12a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" acquired by "delete_volume" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[36212266-189e-4329-86c7-5922261df6af]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:44 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.551s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:44 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a
Sep 23 00:27:44 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-fd17b778-719f-4eaa-8369-d0b6bd3015c5 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-03fc88a8-dd74-44fb-92fd-2d503c7daf15-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:44 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" returned: 0 in 0.714s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:45 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a
Sep 23 00:27:45 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:45 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" returned: 0 in 0.512s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-bfaeb177-dad4-42e9-958b-bb5bcd73f12a" released by "delete_volume" :: held 1.325s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['ef4e42c3-1d07-4e49-8933-f49d7ac1c049', '637cb24e-e1ac-4671-adec-49e2a631162f', '343ccd02-7081-4955-a817-d852b278ce1b', 'f2d77dd9-ce31-4490-9a33-149b682c11fe'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:45 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:45 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:46 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.310s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3d1cc272-6c76-4150-9e58-f459f3c83e3f tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-bfaeb177-dad4-42e9-958b-bb5bcd73f12a-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-07ade637-ac53-475f-a7ef-e30423cd608c-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-07ade637-ac53-475f-a7ef-e30423cd608c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-07ade637-ac53-475f-a7ef-e30423cd608c" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-07ade637-ac53-475f-a7ef-e30423cd608c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleting offline snapshot 07ade637-ac53-475f-a7ef-e30423cd608c of volume d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] snapshot_file for this snap is: volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3865d12-53c6-42c5-9e49-c8d682e5a1a7]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:46 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c
Sep 23 00:27:46 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Flow 'volume_create_manager' (467660f3-507d-4b38-89e4-9771c2baff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631e5926-973b-48cf-80c9-f0700b7e76e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631e5926-973b-48cf-80c9-f0700b7e76e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-10245968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d847574-49b9-42c9-b48d-69462534d61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f439a46a8c40d6a661f0a1a9846e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:47Z,use_quota=True,user_id='d73a41a4c3b44172ab07b91ab5cc18ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:47 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dd0000-4bb6-41dc-b2be-1cae00a1ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dd0000-4bb6-41dc-b2be-1cae00a1ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5864e336-0d5b-4a31-9631-3d7d348fc375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5864e336-0d5b-4a31-9631-3d7d348fc375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d847574-49b9-42c9-b48d-69462534d61b', 'volume_name': 'volume-9d847574-49b9-42c9-b48d-69462534d61b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75d13e-9dcf-4d56-94e1-6a1521c860ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75d13e-9dcf-4d56-94e1-6a1521c860ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fccb1c-4cfc-44bc-b8a2-1777c514d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:47 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Volume 9d847574-49b9-42c9-b48d-69462534d61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d847574-49b9-42c9-b48d-69462534d61b', 'volume_size': 1}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-10245968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d847574-49b9-42c9-b48d-69462534d61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f439a46a8c40d6a661f0a1a9846e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:47Z,use_quota=True,user_id='d73a41a4c3b44172ab07b91ab5cc18ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Creating volume 9d847574-49b9-42c9-b48d-69462534d61b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:27:47 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c" returned: 0 in 0.682s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:27:47 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b 1073741824
Sep 23 00:27:47 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9017e0-6a30-4849-b0a5-6362465221f0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622
Sep 23 00:27:47 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622" returned: 0 in 0.517s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b 1073741824" returned: 0 in 0.589s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:47 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c
Sep 23 00:27:47 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:47 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b
Sep 23 00:27:47 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:48 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b" returned: 0 in 0.393s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:48 devstack sudo[102603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c
Sep 23 00:27:48 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fccb1c-4cfc-44bc-b8a2-1777c514d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d847574-49b9-42c9-b48d-69462534d61b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bfb084-1cc2-4195-8598-dc0b1950f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:27:48 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Volume volume-9d847574-49b9-42c9-b48d-69462534d61b (9d847574-49b9-42c9-b48d-69462534d61b): created successfully
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bfb084-1cc2-4195-8598-dc0b1950f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Flow 'volume_create_manager' (467660f3-507d-4b38-89e4-9771c2baff79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:27:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-46ae8d12-02cc-40e6-aaea-11b786794177 tempest-VolumeQuotasNegativeTestJSON-124012013 None] Created volume successfully.
Sep 23 00:27:48 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622.07ade637-ac53-475f-a7ef-e30423cd608c" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-07ade637-ac53-475f-a7ef-e30423cd608c" released by "_delete_snapshot" :: held 2.140s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" released by "delete_snapshot" :: held 2.170s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['dc3b55f1-301d-43ff-8abb-ab98720781b1', '7acb3fcf-5a0e-4478-9c19-405d78bc51b0', '8a8af0b1-f4b2-49dd-bf53-e0f812b3aa3b', 'dba0a4e1-71bb-4c0a-be03-f9127141b09c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Delete snapshot completed successfully.
Sep 23 00:27:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d4871ba-9bed-4b88-8a3d-3b46e47ee3b0 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-07ade637-ac53-475f-a7ef-e30423cd608c-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-d0f6ca39-b520-42f2-a79e-dd35f7e51622-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-d0f6ca39-b520-42f2-a79e-dd35f7e51622-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c72b05-7df4-4a94-be9a-24a414374266]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622
Sep 23 00:27:50 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622" returned: 0 in 0.509s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622
Sep 23 00:27:50 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Acquiring lock "cinder-9d847574-49b9-42c9-b48d-69462534d61b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "cinder-9d847574-49b9-42c9-b48d-69462534d61b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Acquiring lock "cinder-quobyte-9d847574-49b9-42c9-b48d-69462534d61b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "cinder-quobyte-9d847574-49b9-42c9-b48d-69462534d61b" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af51682-874c-4c8b-ae3d-92438559646e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:50 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d0f6ca39-b520-42f2-a79e-dd35f7e51622" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-quobyte-d0f6ca39-b520-42f2-a79e-dd35f7e51622" released by "delete_volume" :: held 0.941s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:50 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b
Sep 23 00:27:50 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Created reservations ['e3de0f32-406d-4bb3-9e31-ec7e5ec4978c', 'e8df8692-5603-48e9-b12d-dcef564d933f', '1522fb5c-e4af-4663-a6f8-cdfab91fd6dd', '645bb5cb-0798-4a7c-8ad7-d7694b0cb5c1'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:51 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:51 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b" returned: 0 in 0.626s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack sudo[102631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b
Sep 23 00:27:51 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:51 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.440s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Deleted volume successfully.
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3605fac-23f0-49d7-a309-e26a9e98c534 tempest-CreateVolumesFromSnapshotTest-1555025235 None] Lock "cinder-d0f6ca39-b520-42f2-a79e-dd35f7e51622-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:51 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d847574-49b9-42c9-b48d-69462534d61b" returned: 0 in 0.364s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "cinder-quobyte-9d847574-49b9-42c9-b48d-69462534d61b" released by "delete_volume" :: held 1.060s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Created reservations ['3eab9354-ec65-4e2c-b0fe-e1d99b08a82c', 'f36d96d4-aede-48a3-b845-4a7218d3bd40', '18510d6d-7ae6-470e-95cd-5b1549469f7d', 'adfadd66-6ba1-477a-88f0-8cc44d8e6f5c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:51 devstack sudo[102638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:51 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:52 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:52 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Deleted volume successfully.
Sep 23 00:27:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-539697b9-3749-4c69-bc3a-0d4de16d6abb tempest-VolumeQuotasNegativeTestJSON-124012013 None] Lock "cinder-9d847574-49b9-42c9-b48d-69462534d61b-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:27:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-29a428ee-8147-4047-9f14-0db79cdf5206 req-3c926e6d-3baf-489a-99fb-be1050e31d7f tempest-TestShelveInstance-1586391997 None] Terminate volume connection completed successfully.
Sep 23 00:27:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-29a428ee-8147-4047-9f14-0db79cdf5206 req-3c926e6d-3baf-489a-99fb-be1050e31d7f tempest-TestShelveInstance-1586391997 None] Deleting attachment a97b1961-e88c-4cd4-8f07-99d39530d478. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:27:57 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:27:57 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:27:57 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.418s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:27:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:27:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e4721cb7-58cf-46a5-8773-8ffca5f39e5a req-62405e46-8d3b-40a5-bc4f-1152e800019a tempest-TestShelveInstance-1586391997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:27:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e4721cb7-58cf-46a5-8773-8ffca5f39e5a req-62405e46-8d3b-40a5-bc4f-1152e800019a tempest-TestShelveInstance-1586391997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:27:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-e4721cb7-58cf-46a5-8773-8ffca5f39e5a req-62405e46-8d3b-40a5-bc4f-1152e800019a tempest-TestShelveInstance-1586391997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:27:58 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-e4721cb7-58cf-46a5-8773-8ffca5f39e5a req-62405e46-8d3b-40a5-bc4f-1152e800019a tempest-TestShelveInstance-1586391997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-e0260291-d84a-45bc-b50e-28d6e27b5505', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25859dbe-c1bb-42fe-90ac-d14ade6e7363', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:27:58 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-e4721cb7-58cf-46a5-8773-8ffca5f39e5a req-62405e46-8d3b-40a5-bc4f-1152e800019a tempest-TestShelveInstance-1586391997 None] attachment_update completed successfully.
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (4e765713-8bd5-4af5-8f51-72e739415032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3e490-37de-47db-884b-a297be0384d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf3e490-37de-47db-884b-a297be0384d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1032166295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3813eb-ea68-4937-985e-12eee3854211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba61b81-0956-41ef-9eb1-de76bd4a4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba61b81-0956-41ef-9eb1-de76bd4a4386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3be6ba-559a-4a6a-a514-c1d335e66856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3be6ba-559a-4a6a-a514-c1d335e66856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd3813eb-ea68-4937-985e-12eee3854211', 'volume_name': 'volume-bd3813eb-ea68-4937-985e-12eee3854211', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bbde9d-f5ec-4cc5-8c78-98c327c6e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bbde9d-f5ec-4cc5-8c78-98c327c6e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718cf1e7-2b1b-41b0-b627-c350353c8ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:03 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Volume bd3813eb-ea68-4937-985e-12eee3854211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd3813eb-ea68-4937-985e-12eee3854211', 'volume_size': 1}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1032166295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3813eb-ea68-4937-985e-12eee3854211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Creating volume bd3813eb-ea68-4937-985e-12eee3854211 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:03 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:03 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 1073741824
Sep 23 00:28:03 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:04 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 1073741824" returned: 0 in 0.780s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:04 devstack sudo[103160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211
Sep 23 00:28:04 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:04 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211" returned: 0 in 0.277s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718cf1e7-2b1b-41b0-b627-c350353c8ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd3813eb-ea68-4937-985e-12eee3854211', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10523af8-be70-4311-90b7-0359e4116f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:04 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Volume volume-bd3813eb-ea68-4937-985e-12eee3854211 (bd3813eb-ea68-4937-985e-12eee3854211): created successfully
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10523af8-be70-4311-90b7-0359e4116f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (4e765713-8bd5-4af5-8f51-72e739415032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:04 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-12bc2750-b24c-4d39-a950-8ac31c2ff68f tempest-VolumesListAdminTestJSON-134396086 None] Created volume successfully.
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (dd3fc26f-ad3a-4daa-8160-ba4b65e14b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11ef359-9b6b-4c8e-be7d-6cc584548949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11ef359-9b6b-4c8e-be7d-6cc584548949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-380673840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de01b979-d453-4992-bf83-3474e1dfbf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:06Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836dc118-6918-4ae3-bc59-638e839e48b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836dc118-6918-4ae3-bc59-638e839e48b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde434a0-9265-4421-87eb-38ddc12f91d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde434a0-9265-4421-87eb-38ddc12f91d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de01b979-d453-4992-bf83-3474e1dfbf50', 'volume_name': 'volume-de01b979-d453-4992-bf83-3474e1dfbf50', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c12b7c-14ee-4345-bc2c-e8ebe7ae1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c12b7c-14ee-4345-bc2c-e8ebe7ae1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d28783a-df02-479f-b1db-f584340e9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Volume de01b979-d453-4992-bf83-3474e1dfbf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de01b979-d453-4992-bf83-3474e1dfbf50', 'volume_size': 1}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-380673840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de01b979-d453-4992-bf83-3474e1dfbf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:06Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Creating volume de01b979-d453-4992-bf83-3474e1dfbf50 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:06 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 1073741824
Sep 23 00:28:06 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:06 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 1073741824" returned: 0 in 0.541s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:06 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50
Sep 23 00:28:06 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:07 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d28783a-df02-479f-b1db-f584340e9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de01b979-d453-4992-bf83-3474e1dfbf50', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036e126-2832-4b89-9022-7e668e18d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Volume volume-de01b979-d453-4992-bf83-3474e1dfbf50 (de01b979-d453-4992-bf83-3474e1dfbf50): created successfully
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a036e126-2832-4b89-9022-7e668e18d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (dd3fc26f-ad3a-4daa-8160-ba4b65e14b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0d79c62c-81fb-4086-8f31-71373bf2cb9a tempest-VolumesListAdminTestJSON-134396086 None] Created volume successfully.
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (de6a8e07-b1d2-4a1b-bf91-c36d820b7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d5c45d-94d3-4c2a-897f-6fe83cf2531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d5c45d-94d3-4c2a-897f-6fe83cf2531f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-833210521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:09Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3e204d-987b-47e9-b1f1-71f2d6fb171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3e204d-987b-47e9-b1f1-71f2d6fb171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09234c21-78b1-4a79-9ba3-8970a9eaa7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09234c21-78b1-4a79-9ba3-8970a9eaa7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e', 'volume_name': 'volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1105a3e8-f04a-4229-ac4b-c57728bac22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1105a3e8-f04a-4229-ac4b-c57728bac22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f4aff-274e-4927-b32d-4f2d1624e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Volume cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e', 'volume_size': 1}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-833210521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803bb839536a4db89fea3f694bb52f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:09Z,use_quota=True,user_id='8c2cd28008e742d4afea50911d8d88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Creating volume cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:09 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:09 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e 1073741824
Sep 23 00:28:09 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:09 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e 1073741824" returned: 0 in 0.591s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:09 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e
Sep 23 00:28:09 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:09 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" returned: 0 in 0.328s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f4aff-274e-4927-b32d-4f2d1624e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb661132-d6fa-4fe8-bed1-1103c4eeb8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Volume volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e (cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e): created successfully
Sep 23 00:28:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb661132-d6fa-4fe8-bed1-1103c4eeb8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Flow 'volume_create_manager' (de6a8e07-b1d2-4a1b-bf91-c36d820b7afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-23275f46-4111-4a7c-bb91-b7970abb6ed8 tempest-VolumesListAdminTestJSON-134396086 None] Created volume successfully.
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Flow 'volume_create_manager' (32ade2cf-ec79-4685-a807-963cef02a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb024a9-638b-4338-9c07-69ae81e9da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb024a9-638b-4338-9c07-69ae81e9da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1005e0-5c08-4647-88ca-138d2ab1d9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f1430ebe3145a1ae0baf4a54ace89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:12Z,use_quota=True,user_id='e151ce042fab4da1b173e8fd76cbdd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eb8982-cce2-4540-9f54-2807bcf49f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eb8982-cce2-4540-9f54-2807bcf49f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddebda5-79d7-4b84-bb4a-6300905ef650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddebda5-79d7-4b84-bb4a-6300905ef650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1005e0-5c08-4647-88ca-138d2ab1d9c9', 'volume_name': 'volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69068c7-42aa-4b63-b1bb-a232bf0600c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69068c7-42aa-4b63-b1bb-a232bf0600c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b925804-f26a-40c1-a7b4-7461c67c9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Volume 2c1005e0-5c08-4647-88ca-138d2ab1d9c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9', 'volume_size': 1}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1005e0-5c08-4647-88ca-138d2ab1d9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f1430ebe3145a1ae0baf4a54ace89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:12Z,use_quota=True,user_id='e151ce042fab4da1b173e8fd76cbdd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Creating volume 2c1005e0-5c08-4647-88ca-138d2ab1d9c9 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:12 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:12 devstack sudo[103184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 1073741824
Sep 23 00:28:12 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 1073741824" returned: 0 in 0.527s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:12 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9
Sep 23 00:28:12 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:12 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b925804-f26a-40c1-a7b4-7461c67c9083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2db4e-7d80-4aa7-a19d-965e7820219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Volume volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 (2c1005e0-5c08-4647-88ca-138d2ab1d9c9): created successfully
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2db4e-7d80-4aa7-a19d-965e7820219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Flow 'volume_create_manager' (32ade2cf-ec79-4685-a807-963cef02a43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-06db22f3-22e0-4f60-a964-21a43c3f0a53 tempest-VolumesListAdminTestJSON-1661781957 None] Created volume successfully.
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Acquiring lock "cinder-2c1005e0-5c08-4647-88ca-138d2ab1d9c9-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "cinder-2c1005e0-5c08-4647-88ca-138d2ab1d9c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Acquiring lock "cinder-quobyte-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "cinder-quobyte-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9e06f-1880-4e2c-8061-86a89e5949da]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-quobyte-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:14 devstack sudo[103192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9
Sep 23 00:28:14 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b7169-83bc-4627-9d29-7beb65faab5d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:14 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e
Sep 23 00:28:14 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:14 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" returned: 0 in 0.514s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:14 devstack sudo[103199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9
Sep 23 00:28:14 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" returned: 0 in 0.468s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:15 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e
Sep 23 00:28:15 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "cinder-quobyte-2c1005e0-5c08-4647-88ca-138d2ab1d9c9" released by "delete_volume" :: held 0.905s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Created reservations ['17365fbd-e17e-4501-90db-50e12194c8eb', '60edea66-9dca-4501-819e-c558175cd10b', 'db195b77-215d-4e9e-afd2-01e9105a6851', '73620862-a9f0-48fa-acc2-f4097aa61886'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:15 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" returned: 0 in 0.303s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e" released by "delete_volume" :: held 0.848s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:15 devstack sudo[103208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:15 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Created reservations ['5346302b-4675-47e7-89a8-333c161ab9dd', '694fed32-18be-4e12-a8f5-bbd54c2e24bd', 'd4688a4d-f44a-4e05-9e68-a676265b4fb2', '2d2e4278-5b90-4673-98cb-980a488bb16d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:15 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:15 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-de01b979-d453-4992-bf83-3474e1dfbf50-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-de01b979-d453-4992-bf83-3474e1dfbf50-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-quobyte-de01b979-d453-4992-bf83-3474e1dfbf50" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-de01b979-d453-4992-bf83-3474e1dfbf50" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61443e-3425-4058-ac2b-672b89a0d265]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.603s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Deleted volume successfully.
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-457d84e8-b48d-47a7-bc52-b6afd7360e26 tempest-VolumesListAdminTestJSON-1661781957 None] Lock "cinder-2c1005e0-5c08-4647-88ca-138d2ab1d9c9-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:16 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.508s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Deleted volume successfully.
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87821696-167d-4a8f-ad64-667e8a72efab tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-cadbdc7c-0a4f-4bd9-9999-ec4d766b8b7e-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:16 devstack sudo[103213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50
Sep 23 00:28:16 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:16 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50" returned: 0 in 0.541s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:16 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50
Sep 23 00:28:16 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:16 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de01b979-d453-4992-bf83-3474e1dfbf50" returned: 0 in 0.288s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-de01b979-d453-4992-bf83-3474e1dfbf50" released by "delete_volume" :: held 0.914s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:16 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Created reservations ['ee0c26b1-b8b5-48b9-adf1-1a04109538c5', 'c2d1ee8a-4997-4cac-9443-f7b6ca3b27af', 'ec81fe75-d246-47b8-97e2-f21cb205cde0', 'a05d43a8-93ee-40f0-8b06-4ab1b2f69402'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:17 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-bd3813eb-ea68-4937-985e-12eee3854211-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-bd3813eb-ea68-4937-985e-12eee3854211-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "cinder-quobyte-bd3813eb-ea68-4937-985e-12eee3854211" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-bd3813eb-ea68-4937-985e-12eee3854211" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6205709-81d6-46c8-9754-714f56d2bfbb]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.365s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Deleted volume successfully.
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ab0272f0-c211-4ae4-8e87-7a95f534c81f tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-de01b979-d453-4992-bf83-3474e1dfbf50-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:17 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211
Sep 23 00:28:17 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:17 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211" returned: 0 in 0.475s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:17 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211
Sep 23 00:28:17 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:18 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bd3813eb-ea68-4937-985e-12eee3854211" returned: 0 in 0.318s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-quobyte-bd3813eb-ea68-4937-985e-12eee3854211" released by "delete_volume" :: held 0.854s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Created reservations ['fb2447f7-ca8b-4c71-84a1-07cbb535aa7c', '49e16a35-bd5c-4394-baac-73b018a81d0a', '6b2901af-dd7c-4d93-8a14-6b282acd6360', 'b8e72e8c-1aeb-4ff0-886e-f21285f6c416'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:18 devstack sudo[103233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:18 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:18 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Deleted volume successfully.
Sep 23 00:28:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-70ad6276-cd8e-403a-84c5-4d056ea61f8d tempest-VolumesListAdminTestJSON-134396086 None] Lock "cinder-bd3813eb-ea68-4937-985e-12eee3854211-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=105,cinder:UPDATE=160,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=143,cinder:SELECT=111,cinder:INSERT=37,cinder:DELETE=16 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (f7baf51d-76e8-446f-8ba3-ce9a7ba8408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee792666-0d79-415a-94d0-88c269cdff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee792666-0d79-415a-94d0-88c269cdff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-790018574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c022b01-89c0-4ac1-80b2-22cec33c515c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:29Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cec67d8-5e9e-45d8-9b74-2d4221d98f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cec67d8-5e9e-45d8-9b74-2d4221d98f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf406b-49e0-4655-951d-f762f499efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf406b-49e0-4655-951d-f762f499efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c022b01-89c0-4ac1-80b2-22cec33c515c', 'volume_name': 'volume-3c022b01-89c0-4ac1-80b2-22cec33c515c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3831052f-b019-4349-8896-09061cda4e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3831052f-b019-4349-8896-09061cda4e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f0e60f-849f-4dd0-b8e3-e2457f801b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:29 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Volume 3c022b01-89c0-4ac1-80b2-22cec33c515c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c022b01-89c0-4ac1-80b2-22cec33c515c', 'volume_size': 1}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-790018574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c022b01-89c0-4ac1-80b2-22cec33c515c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:29Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Creating volume 3c022b01-89c0-4ac1-80b2-22cec33c515c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:29 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:29 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c 1073741824
Sep 23 00:28:29 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:29 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c 1073741824" returned: 0 in 0.486s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:29 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c
Sep 23 00:28:29 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:29 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f0e60f-849f-4dd0-b8e3-e2457f801b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c022b01-89c0-4ac1-80b2-22cec33c515c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb059f11-45e3-4a91-8c2a-f50c5d22d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:29 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Volume volume-3c022b01-89c0-4ac1-80b2-22cec33c515c (3c022b01-89c0-4ac1-80b2-22cec33c515c): created successfully
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb059f11-45e3-4a91-8c2a-f50c5d22d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (f7baf51d-76e8-446f-8ba3-ce9a7ba8408e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2e38ba62-d291-48cd-9f72-46d442de1dc6 tempest-VolumesListTestJSON-1439627495 None] Created volume successfully.
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (69b54a77-3f43-4a45-904d-aa96e6250f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239538c-d248-4d46-b769-6f6f2c0df8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239538c-d248-4d46-b769-6f6f2c0df8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-817063661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3543f0ea-d4c0-4fa8-a29a-0736a7838d77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:32Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7a7039-1994-4072-81a3-4436f4503073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7a7039-1994-4072-81a3-4436f4503073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba56fbe-ca02-4045-88d8-0f725ba9c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba56fbe-ca02-4045-88d8-0f725ba9c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3543f0ea-d4c0-4fa8-a29a-0736a7838d77', 'volume_name': 'volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cedf4f7-a95a-4b1e-aa9a-cf6dd10e16ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cedf4f7-a95a-4b1e-aa9a-cf6dd10e16ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0566cb84-43d4-4121-8c14-ec75f4503508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:31 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Volume 3543f0ea-d4c0-4fa8-a29a-0736a7838d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77', 'volume_size': 1}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-817063661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3543f0ea-d4c0-4fa8-a29a-0736a7838d77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:32Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Creating volume 3543f0ea-d4c0-4fa8-a29a-0736a7838d77 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:31 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:31 devstack sudo[103284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 1073741824
Sep 23 00:28:31 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:32 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 1073741824" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:32 devstack sudo[103290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77
Sep 23 00:28:32 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:32 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" returned: 0 in 0.306s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0566cb84-43d4-4121-8c14-ec75f4503508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321ff56a-764b-4a71-ab73-a98a77984622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Volume volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 (3543f0ea-d4c0-4fa8-a29a-0736a7838d77): created successfully
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321ff56a-764b-4a71-ab73-a98a77984622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (69b54a77-3f43-4a45-904d-aa96e6250f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-58f05f4a-5f63-4bd0-b20f-aaa5480a70c8 tempest-VolumesListTestJSON-1439627495 None] Created volume successfully.
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (5195f86f-e676-45aa-b18e-96bb21bee882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4721e21-339a-4de5-9da5-2a24afa35c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4721e21-339a-4de5-9da5-2a24afa35c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36363518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757f3165-cf6a-49b9-9421-9b849e8885ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0123c0dc-ae00-40c1-ac09-70b627fd282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0123c0dc-ae00-40c1-ac09-70b627fd282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e793c-1c55-4903-89e9-59eb24d71374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e793c-1c55-4903-89e9-59eb24d71374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757f3165-cf6a-49b9-9421-9b849e8885ed', 'volume_name': 'volume-757f3165-cf6a-49b9-9421-9b849e8885ed', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1f3902-45d7-4268-874b-045955947f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1f3902-45d7-4268-874b-045955947f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15caafe-41b1-4668-9b75-56efe257361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Volume 757f3165-cf6a-49b9-9421-9b849e8885ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757f3165-cf6a-49b9-9421-9b849e8885ed', 'volume_size': 1}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36363518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757f3165-cf6a-49b9-9421-9b849e8885ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='596ec0c98cd74bbdaf5e5d07b7c8e5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='5fdbeaf224674307bc9dfdbb50b8c41c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Creating volume 757f3165-cf6a-49b9-9421-9b849e8885ed {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:34 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed 1073741824
Sep 23 00:28:34 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:35 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed 1073741824" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:35 devstack sudo[103300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed
Sep 23 00:28:35 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:35 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed" returned: 0 in 0.299s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15caafe-41b1-4668-9b75-56efe257361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757f3165-cf6a-49b9-9421-9b849e8885ed', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699a7f42-f49b-4299-96b8-e5a5373546cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Volume volume-757f3165-cf6a-49b9-9421-9b849e8885ed (757f3165-cf6a-49b9-9421-9b849e8885ed): created successfully
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699a7f42-f49b-4299-96b8-e5a5373546cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Flow 'volume_create_manager' (5195f86f-e676-45aa-b18e-96bb21bee882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3765ee25-990f-4e47-9f62-d1f211223224 tempest-VolumesListTestJSON-1439627495 None] Created volume successfully.
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-757f3165-cf6a-49b9-9421-9b849e8885ed-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-757f3165-cf6a-49b9-9421-9b849e8885ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-quobyte-757f3165-cf6a-49b9-9421-9b849e8885ed" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-757f3165-cf6a-49b9-9421-9b849e8885ed" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a534b-f086-40fe-8b45-a876ad0d419f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:39 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed
Sep 23 00:28:39 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:39 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed" returned: 0 in 0.500s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:39 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed
Sep 23 00:28:39 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:39 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-757f3165-cf6a-49b9-9421-9b849e8885ed" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-757f3165-cf6a-49b9-9421-9b849e8885ed" released by "delete_volume" :: held 0.885s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Created reservations ['aeadea7b-2e6d-4a88-8fdb-be030b60a849', '012a54c3-4701-47a8-be81-44ecdc724a3a', '96ac6255-faf5-4b0e-832d-2115ad8716d1', 'b2c95562-b9ab-40a5-8471-a0dbadb1a82f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:40 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:40 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-3543f0ea-d4c0-4fa8-a29a-0736a7838d77-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-3543f0ea-d4c0-4fa8-a29a-0736a7838d77-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-quobyte-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06ab534-88ac-46c0-b739-eecb97040483]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:40 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Deleted volume successfully.
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3409cb7-23f3-4d34-83b8-0a174e0b6d98 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-757f3165-cf6a-49b9-9421-9b849e8885ed-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:40 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77
Sep 23 00:28:40 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:40 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" returned: 0 in 0.462s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:41 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77
Sep 23 00:28:41 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:41 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-3543f0ea-d4c0-4fa8-a29a-0736a7838d77" released by "delete_volume" :: held 0.822s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Created reservations ['c859f725-d5e8-4f08-a89c-f755cd0e6323', 'f05bf975-ba80-474b-8d9b-d4a02afa777f', 'f9cfc64a-6af0-404a-895f-288f17d63d5f', 'f7c1b0ca-ffce-423e-be31-5f40ef7416f7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:41 devstack sudo[103333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:41 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-3c022b01-89c0-4ac1-80b2-22cec33c515c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-3c022b01-89c0-4ac1-80b2-22cec33c515c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "cinder-quobyte-3c022b01-89c0-4ac1-80b2-22cec33c515c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-3c022b01-89c0-4ac1-80b2-22cec33c515c" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f700b0c0-1ac3-4ef0-9fc3-e362cca655b4]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:41 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.420s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Deleted volume successfully.
Sep 23 00:28:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-26b060e3-0254-4c0b-8afb-5e0bf40dbf5c tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-3543f0ea-d4c0-4fa8-a29a-0736a7838d77-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:42 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c
Sep 23 00:28:42 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:42 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c" returned: 0 in 0.542s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:42 devstack sudo[103342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c
Sep 23 00:28:42 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:42 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3c022b01-89c0-4ac1-80b2-22cec33c515c" returned: 0 in 0.351s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-quobyte-3c022b01-89c0-4ac1-80b2-22cec33c515c" released by "delete_volume" :: held 0.965s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Created reservations ['79376e48-f9fa-44c2-967e-05a116dbc10b', '809a1f30-da7b-494c-b081-d3ebfc8f8243', '9dd73f4b-7ec7-44a7-b702-85ad7e297257', '0e95b858-6f4a-4c09-9a0d-63011b1a553e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:43 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:43 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:43 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.463s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Deleted volume successfully.
Sep 23 00:28:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-132dd8fd-56de-4592-9bbd-8311628c3197 tempest-VolumesListTestJSON-1439627495 None] Lock "cinder-3c022b01-89c0-4ac1-80b2-22cec33c515c-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-5867320c-e809-46b1-af3a-d4667c25d03b tempest-TestShelveInstance-1586391997 None] Terminate volume connection completed successfully.
Sep 23 00:28:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-5867320c-e809-46b1-af3a-d4667c25d03b tempest-TestShelveInstance-1586391997 None] Deleting attachment 25859dbe-c1bb-42fe-90ac-d14ade6e7363. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:28:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Acquiring lock "cinder-e0260291-d84a-45bc-b50e-28d6e27b5505-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "cinder-e0260291-d84a-45bc-b50e-28d6e27b5505-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Acquiring lock "cinder-quobyte-e0260291-d84a-45bc-b50e-28d6e27b5505" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:28:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "cinder-quobyte-e0260291-d84a-45bc-b50e-28d6e27b5505" acquired by "delete_volume" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:28:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4e4c3-1b8c-429e-9a5f-d1d9c3dc45df]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:28:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:45 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505
Sep 23 00:28:45 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:45 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505" returned: 0 in 0.700s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:45 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505
Sep 23 00:28:45 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:46 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e0260291-d84a-45bc-b50e-28d6e27b5505" returned: 0 in 0.417s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "cinder-quobyte-e0260291-d84a-45bc-b50e-28d6e27b5505" released by "delete_volume" :: held 1.199s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.quota [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Created reservations ['92d57886-e209-4155-8002-64c568ba04a5', '08749307-4c03-407f-8c65-ec9aee5147df', '47b09d75-7c04-4a80-8cea-b999697a6ea0', 'eaa07faf-47ec-4c0f-bd2a-15b0c990409f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:46 devstack sudo[103417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:46 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:46 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.382s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.manager [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Deleted volume successfully.
Sep 23 00:28:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [req-a9bfabd9-269d-46d8-8a20-10b92adf8db5 req-35e97599-a9c2-41d1-8437-815063171c82 tempest-TestShelveInstance-1586391997 None] Lock "cinder-e0260291-d84a-45bc-b50e-28d6e27b5505-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Flow 'volume_create_manager' (7f8f1071-031a-44b3-81e9-5b94657e0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5605e4d2-eaaf-4814-826f-c1016b19b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5605e4d2-eaaf-4814-826f-c1016b19b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1782503945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febbac58-7e68-4dec-ae50-3b7ebcd5fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc24709c025c419da281b9af80f87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:50Z,use_quota=True,user_id='1e8592374e9840c8afc8d25c0f6689ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34be5bc9-d52b-499b-b0bd-b14d592b6cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34be5bc9-d52b-499b-b0bd-b14d592b6cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55017e8-912c-4cbf-b231-56db9bf93f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55017e8-912c-4cbf-b231-56db9bf93f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febbac58-7e68-4dec-ae50-3b7ebcd5fea0', 'volume_name': 'volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90cb32d-a046-4831-b0df-0fa0e1f66611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90cb32d-a046-4831-b0df-0fa0e1f66611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eddeb3-a484-48ec-8a33-da1dc575cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Volume febbac58-7e68-4dec-ae50-3b7ebcd5fea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0', 'volume_size': 1}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1782503945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febbac58-7e68-4dec-ae50-3b7ebcd5fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc24709c025c419da281b9af80f87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:50Z,use_quota=True,user_id='1e8592374e9840c8afc8d25c0f6689ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Creating volume febbac58-7e68-4dec-ae50-3b7ebcd5fea0 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:28:50 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:50 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 1073741824
Sep 23 00:28:50 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:50 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 1073741824" returned: 0 in 0.729s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:50 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0
Sep 23 00:28:50 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:51 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" returned: 0 in 0.467s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eddeb3-a484-48ec-8a33-da1dc575cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097c0a1-c70f-4efc-902c-5256be1ddc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:28:51 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Volume volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 (febbac58-7e68-4dec-ae50-3b7ebcd5fea0): created successfully
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097c0a1-c70f-4efc-902c-5256be1ddc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:28:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Flow 'volume_create_manager' (7f8f1071-031a-44b3-81e9-5b94657e0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:28:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a6da392e-635c-45c6-b40d-b271f4b0f765 tempest-VolumesNegativeTest-743398362 None] Created volume successfully.
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:28:57 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:28:57 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:28:57 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.363s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:28:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:29:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=30,cinder:UPDATE=50,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=38,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Acquiring lock "cinder-febbac58-7e68-4dec-ae50-3b7ebcd5fea0-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "cinder-febbac58-7e68-4dec-ae50-3b7ebcd5fea0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Acquiring lock "cinder-quobyte-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "cinder-quobyte-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b5352-9a73-47bb-8cd0-d6022b9ace3a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:15 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0
Sep 23 00:29:15 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:15 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:15 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0
Sep 23 00:29:15 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:16 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" returned: 0 in 0.352s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "cinder-quobyte-febbac58-7e68-4dec-ae50-3b7ebcd5fea0" released by "delete_volume" :: held 0.916s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Created reservations ['1414eded-fb21-4a19-ae3f-f65e35b408df', '268d906d-2e02-4d1a-8605-1c16420c5799', '258e9c3c-fcfd-48e8-a032-df0408455768', 'f2ba600d-2cf3-4fa5-ac5b-20fefa25ebbd'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:16 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:29:16 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:16 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.307s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Deleted volume successfully.
Sep 23 00:29:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-67b96769-492d-440a-a050-d80aa116b2ec tempest-VolumesNegativeTest-743398362 None] Lock "cinder-febbac58-7e68-4dec-ae50-3b7ebcd5fea0-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Flow 'volume_create_manager' (c205fbd0-8b9b-4f1a-a513-3766618b5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73fefb5-c465-47c7-b9ef-88d2a80f5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73fefb5-c465-47c7-b9ef-88d2a80f5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-327314673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3e5883-408c-43bc-ab56-4bbda880bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa071600954439f8a8ef45a757f9e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:22Z,use_quota=True,user_id='4ab088a81ae64bb2b1aa326dc7818ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb6ec94-076c-4b0e-ba6f-0590996a6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb6ec94-076c-4b0e-ba6f-0590996a6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36785e2-e6f6-463d-9ece-a7f20d12e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36785e2-e6f6-463d-9ece-a7f20d12e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3e5883-408c-43bc-ab56-4bbda880bb89', 'volume_name': 'volume-1e3e5883-408c-43bc-ab56-4bbda880bb89', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c139b97-ecb3-428f-8b5d-ea5e11fc447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c139b97-ecb3-428f-8b5d-ea5e11fc447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c15784-dfd4-4355-b5df-8bccc64ff80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:21 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Volume 1e3e5883-408c-43bc-ab56-4bbda880bb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3e5883-408c-43bc-ab56-4bbda880bb89', 'volume_size': 1}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-327314673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3e5883-408c-43bc-ab56-4bbda880bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa071600954439f8a8ef45a757f9e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:22Z,use_quota=True,user_id='4ab088a81ae64bb2b1aa326dc7818ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Creating volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:21 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:29:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:21 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 1073741824
Sep 23 00:29:21 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:22 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 1073741824" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:22 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89
Sep 23 00:29:22 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:22 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89" returned: 0 in 0.296s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c15784-dfd4-4355-b5df-8bccc64ff80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3e5883-408c-43bc-ab56-4bbda880bb89', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49f3c5-5f03-4bb0-81b3-edec90a475b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:22 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Volume volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 (1e3e5883-408c-43bc-ab56-4bbda880bb89): created successfully
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a49f3c5-5f03-4bb0-81b3-edec90a475b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Flow 'volume_create_manager' (c205fbd0-8b9b-4f1a-a513-3766618b5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b9003e86-6fc4-428a-a999-4bf2114d9739 tempest-VolumesSnapshotListTestJSON-1990569280 None] Created volume successfully.
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Creating offline snapshot fc8f9eee-de4e-412f-bb37-3dcb3abedcbd of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f98e5-a2aa-475e-b09a-cb22be62ec83]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:24 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89
Sep 23 00:29:24 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:24 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:24 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd 1G
Sep 23 00:29:24 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:25 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd 1G" returned: 0 in 0.583s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:25 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:25 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:25 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:25 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd is being set with open permissions: ugo+rw
Sep 23 00:29:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:25 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:25 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:26 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:26 devstack sudo[103600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info
Sep 23 00:29:26 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:26 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:26 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info is being set with open permissions: ugo+rw
Sep 23 00:29:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:26 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info
Sep 23 00:29:26 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:26 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.info" returned: 0 in 0.350s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-54050cb3-d3e7-4ddf-a835-ba905500217e tempest-VolumesSnapshotListTestJSON-1990569280 None] Create snapshot completed successfully
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Creating offline snapshot 1215d75b-6a7f-429d-bded-e154a3406a54 of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e0cb78-acfa-471b-ba30-c10d144774f4]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:28 devstack sudo[103606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:28 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:28 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:28 devstack sudo[103611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 1G
Sep 23 00:29:28 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:29 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 1G" returned: 0 in 0.587s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:29 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:29 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:29 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.392s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 is being set with open permissions: ugo+rw
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:29 devstack sudo[103624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:29 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:29 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e52546aa-6450-4562-9db6-92b2f0b69128 tempest-VolumesSnapshotListTestJSON-1990569280 None] Create snapshot completed successfully
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Creating offline snapshot 2389cd41-8b70-44c1-b3f6-0501ab79d733 of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b8007-fe73-4513-8a3f-f5d67c477d9e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:30 devstack sudo[103627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:30 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:30 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.538s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:30 devstack sudo[103633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 1G
Sep 23 00:29:30 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:31 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 1G" returned: 0 in 0.839s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:31 devstack sudo[103638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733
Sep 23 00:29:31 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:32 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733" returned: 0 in 0.401s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:32 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 is being set with open permissions: ugo+rw
Sep 23 00:29:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:32 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733
Sep 23 00:29:32 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:32 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-94d9c628-7e94-4d96-aa4a-7c5d70558368 tempest-VolumesSnapshotListTestJSON-1990569280 None] Create snapshot completed successfully
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-2389cd41-8b70-44c1-b3f6-0501ab79d733-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-2389cd41-8b70-44c1-b3f6-0501ab79d733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-2389cd41-8b70-44c1-b3f6-0501ab79d733" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-2389cd41-8b70-44c1-b3f6-0501ab79d733" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Deleting offline snapshot 2389cd41-8b70-44c1-b3f6-0501ab79d733 of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] snapshot_file for this snap is: volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e817664-b0ab-4613-98bd-61c264d71adf]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:34 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733
Sep 23 00:29:34 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:35 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733" returned: 0 in 0.498s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d276bf-ae03-4f61-86a6-f7ce15de2839]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:35 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:35 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Flow 'volume_create_manager' (d369031b-fbc9-442d-98b2-5248e729d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eab140-31b2-410a-996c-0b654d1895b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eab140-31b2-410a-996c-0b654d1895b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-760435985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93be0af4-9829-4878-8297-ad1d990b2bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d95661851245cca01d67f118b9b148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='be990e616ebd48578ffe03b11615d5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4faf63-884e-4def-b38a-6c782d8aaeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4faf63-884e-4def-b38a-6c782d8aaeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:35 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a669c26f-1ac0-4c72-9665-c1ce4457fa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a669c26f-1ac0-4c72-9665-c1ce4457fa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93be0af4-9829-4878-8297-ad1d990b2bc3', 'volume_name': 'volume-93be0af4-9829-4878-8297-ad1d990b2bc3', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7fc91c-2998-4c61-93ee-90d6990d7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7fc91c-2998-4c61-93ee-90d6990d7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2343a207-a2fe-4f06-830a-0272da10468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:35 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Volume 93be0af4-9829-4878-8297-ad1d990b2bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93be0af4-9829-4878-8297-ad1d990b2bc3', 'volume_size': 1}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-760435985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93be0af4-9829-4878-8297-ad1d990b2bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d95661851245cca01d67f118b9b148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='be990e616ebd48578ffe03b11615d5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Creating volume 93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:29:35 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.590s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:35 devstack sudo[103658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 1073741824
Sep 23 00:29:35 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:35 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733
Sep 23 00:29:35 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:36 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733" returned: 0 in 0.573s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:36 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 1073741824" returned: 0 in 0.614s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:36 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733
Sep 23 00:29:36 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:36 devstack sudo[103672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:29:36 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:36 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.2389cd41-8b70-44c1-b3f6-0501ab79d733" returned: 0 in 0.387s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-2389cd41-8b70-44c1-b3f6-0501ab79d733" released by "_delete_snapshot" :: held 2.189s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:36 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" released by "delete_snapshot" :: held 2.218s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.382s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2343a207-a2fe-4f06-830a-0272da10468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93be0af4-9829-4878-8297-ad1d990b2bc3', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7b6c8b-f49a-45a5-97ee-d17fafab57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:29:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Volume volume-93be0af4-9829-4878-8297-ad1d990b2bc3 (93be0af4-9829-4878-8297-ad1d990b2bc3): created successfully
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7b6c8b-f49a-45a5-97ee-d17fafab57b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:29:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Flow 'volume_create_manager' (d369031b-fbc9-442d-98b2-5248e729d6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:29:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a6a158c5-3393-4ffd-90fb-abb1a8da949b tempest-TestStampPattern-1289715986 None] Created volume successfully.
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Created reservations ['8e249f40-5f03-4c83-bd90-ecae6479cb36', 'c07f1eec-4e1b-48e1-8240-f26b4f9793f4', '1eca1ef8-f6a9-4d72-99e6-19de18314b62', 'c0b046eb-bcc6-45c9-85bd-030c9bd26059'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:29:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Delete snapshot completed successfully.
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-30943a67-3b65-44c2-a24a-494b7b7cc435 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-2389cd41-8b70-44c1-b3f6-0501ab79d733-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-1215d75b-6a7f-429d-bded-e154a3406a54-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-1215d75b-6a7f-429d-bded-e154a3406a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-1215d75b-6a7f-429d-bded-e154a3406a54" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1215d75b-6a7f-429d-bded-e154a3406a54" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Deleting offline snapshot 1215d75b-6a7f-429d-bded-e154a3406a54 of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] snapshot_file for this snap is: volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cc2d21-8a90-467c-bc79-775edcb97ea8]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:38 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:38 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:38 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.604s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447fe34-ab74-4f84-958b-56e4c137249f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:38 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:38 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:39 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:39 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:39 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:39 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.601s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:39 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54
Sep 23 00:29:39 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:40 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.1215d75b-6a7f-429d-bded-e154a3406a54" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1215d75b-6a7f-429d-bded-e154a3406a54" released by "_delete_snapshot" :: held 2.197s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" released by "delete_snapshot" :: held 2.241s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Created reservations ['6c6db9eb-2b2a-4e20-a9d3-ea4f876db7e3', '37530d01-ad93-4ab2-94d5-3c0697ff8058', '0064a677-0032-4b13-bfe6-be696be773f3', '46ce33e4-55fc-4c06-a26a-5fc7d67c726a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:29:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Delete snapshot completed successfully.
Sep 23 00:29:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2606c0fc-d8bf-4548-9989-6213098a9a8e tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-1215d75b-6a7f-429d-bded-e154a3406a54-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Deleting offline snapshot fc8f9eee-de4e-412f-bb37-3dcb3abedcbd of volume 1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] snapshot_file for this snap is: volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ace43-de36-4361-85eb-31cb3a7a0423]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:41 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:41 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:41 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.482s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e3e5883-408c-43bc-ab56-4bbda880bb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc542e7f-da2c-409f-9037-be1171bb1e96]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:42 devstack sudo[103736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89
Sep 23 00:29:42 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:42 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89" returned: 0 in 0.844s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:42 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:42 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:43 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.558s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:43 devstack sudo[103805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd
Sep 23 00:29:43 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:43 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89.fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" returned: 0 in 0.282s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd" released by "_delete_snapshot" :: held 2.403s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" released by "delete_snapshot" :: held 2.430s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Created reservations ['a1ac5d39-7711-4727-a21b-020f600c040f', 'f0edf5a6-2590-4382-9aa1-c43b629a6c02', '3c3d649e-3117-47a6-82e1-a6f91f29b99a', '930fcd78-485e-499b-860e-f97990c8f457'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:29:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Delete snapshot completed successfully.
Sep 23 00:29:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-39d30319-9c93-441a-acb1-c623a56bc879 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-fc8f9eee-de4e-412f-bb37-3dcb3abedcbd-delete_snapshot" released by "delete_snapshot" :: held 2.633s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-1e3e5883-408c-43bc-ab56-4bbda880bb89-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-1e3e5883-408c-43bc-ab56-4bbda880bb89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedabd5e-db82-492c-8935-6fbef7f5c967]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:29:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:44 devstack sudo[103810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89
Sep 23 00:29:44 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:45 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89" returned: 0 in 0.486s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:45 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89
Sep 23 00:29:45 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:45 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1e3e5883-408c-43bc-ab56-4bbda880bb89" returned: 0 in 0.391s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-quobyte-1e3e5883-408c-43bc-ab56-4bbda880bb89" released by "delete_volume" :: held 0.976s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Created reservations ['5456d49b-1338-44d8-ae3b-deee63790d84', '623d9eeb-e347-4247-a1ca-38b5d71621cc', 'f230db67-785f-4a00-b83e-e847a5d1deb3', 'f7fb676a-6adf-4992-9af8-2c3d035c33db'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:45 devstack sudo[103818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:29:45 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:46 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:46 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Deleted volume successfully.
Sep 23 00:29:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b8299473-51de-4879-88b7-92bcae18ed25 tempest-VolumesSnapshotListTestJSON-1990569280 None] Lock "cinder-1e3e5883-408c-43bc-ab56-4bbda880bb89-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:29:55 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=36,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:56 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=39,cinder:UPDATE=43,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:29:57 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:29:57 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:29:57 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:29:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:30:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-9255d23f-e24e-4bdf-bb59-f5c7e116de0e req-78c10cd0-b3a3-4882-8e12-350189f27377 tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-9255d23f-e24e-4bdf-bb59-f5c7e116de0e req-78c10cd0-b3a3-4882-8e12-350189f27377 tempest-TestStampPattern-1289715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-9255d23f-e24e-4bdf-bb59-f5c7e116de0e req-78c10cd0-b3a3-4882-8e12-350189f27377 tempest-TestStampPattern-1289715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-9255d23f-e24e-4bdf-bb59-f5c7e116de0e req-78c10cd0-b3a3-4882-8e12-350189f27377 tempest-TestStampPattern-1289715986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-93be0af4-9829-4878-8297-ad1d990b2bc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9e8b3ae-88c8-4c8e-b294-c4c62452f8f8', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:30:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-9255d23f-e24e-4bdf-bb59-f5c7e116de0e req-78c10cd0-b3a3-4882-8e12-350189f27377 tempest-TestStampPattern-1289715986 None] attachment_update completed successfully.
Sep 23 00:30:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-8b5b67e7-80fb-421f-bc23-cef30e171472 req-505bba25-2dc2-47e4-b4b5-312f24b46bf2 tempest-TestStampPattern-1289715986 None] Terminate volume connection completed successfully.
Sep 23 00:30:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-8b5b67e7-80fb-421f-bc23-cef30e171472 req-505bba25-2dc2-47e4-b4b5-312f24b46bf2 tempest-TestStampPattern-1289715986 None] Deleting attachment b9e8b3ae-88c8-4c8e-b294-c4c62452f8f8. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:30:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Creating offline snapshot fe77400c-0c93-423e-9999-886d01ec0ff5 of volume 93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:30:17 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2bad1d-5dd6-469b-a463-c0197c13fdfd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:17 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:30:17 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:18 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.564s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:18 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 1G
Sep 23 00:30:18 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:18 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 1G" returned: 0 in 0.608s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93be0af4-9829-4878-8297-ad1d990b2bc3 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:18 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93be0af4-9829-4878-8297-ad1d990b2bc3 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:30:18 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:19 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93be0af4-9829-4878-8297-ad1d990b2bc3 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.412s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:19 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 is being set with open permissions: ugo+rw
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:19 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:30:19 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:19 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:19 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info
Sep 23 00:30:19 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:19 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info" returned: 0 in 0.363s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:19 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info is being set with open permissions: ugo+rw
Sep 23 00:30:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:19 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info
Sep 23 00:30:19 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:20 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.info" returned: 0 in 0.323s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9770f904-3843-47a0-ba59-32fdc3e2c199 tempest-TestStampPattern-1289715986 None] Create snapshot completed successfully
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Flow 'volume_create_manager' (dfab5d06-e0d8-4d85-93b0-91bb7b1c24e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1971a9-e6b2-480a-8a12-6a4875354d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1971a9-e6b2-480a-8a12-6a4875354d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-109124721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe89a7f-08e6-4a89-a49b-003e418e9290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d95661851245cca01d67f118b9b148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe77400c-0c93-423e-9999-886d01ec0ff5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='be990e616ebd48578ffe03b11615d5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49222749-52fe-4823-b4ad-94cbb901c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49222749-52fe-4823-b4ad-94cbb901c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be964b9-2ba2-48fc-986c-1e0392175eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be964b9-2ba2-48fc-986c-1e0392175eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efe89a7f-08e6-4a89-a49b-003e418e9290', 'volume_name': 'volume-efe89a7f-08e6-4a89-a49b-003e418e9290', 'volume_size': 1, 'snapshot_id': 'fe77400c-0c93-423e-9999-886d01ec0ff5'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3d96d7-6807-4afd-a98b-bec692bb9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3d96d7-6807-4afd-a98b-bec692bb9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9106ee-7343-4bec-9dca-2095fe469ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Volume efe89a7f-08e6-4a89-a49b-003e418e9290: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efe89a7f-08e6-4a89-a49b-003e418e9290', 'volume_size': 1, 'snapshot_id': 'fe77400c-0c93-423e-9999-886d01ec0ff5'}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5-efe89a7f-08e6-4a89-a49b-003e418e9290" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5-efe89a7f-08e6-4a89-a49b-003e418e9290" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Creating volume efe89a7f-08e6-4a89-a49b-003e418e9290 from snapshot fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] snapshot: fe77400c-0c93-423e-9999-886d01ec0ff5, volume: efe89a7f-08e6-4a89-a49b-003e418e9290,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ee84d-968e-4639-8779-4e9740570b72]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:30 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:30:30 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:30 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.503s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93be0af4-9829-4878-8297-ad1d990b2bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1493d2-d626-4a44-81df-1c555149140e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:31 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:30:31 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:31 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.515s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:30:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:30:31 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:30:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:31 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290
Sep 23 00:30:31 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:30:40 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:30:42 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290" returned: 0 in 11.072s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3, size 1024.00 MB, duration 11.07 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:30:42 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Converted 1024.00 MB image at 92.47 MB/s
Sep 23 00:30:42 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 is being set with open permissions: ugo+rw
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:42 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290
Sep 23 00:30:42 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:42 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290" returned: 0 in 0.401s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" released by "_copy_volume_from_snapshot" :: held 12.642s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5-efe89a7f-08e6-4a89-a49b-003e418e9290" released by "_create_volume_from_snapshot" :: held 12.802s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.829s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9106ee-7343-4bec-9dca-2095fe469ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe89a7f-08e6-4a89-a49b-003e418e9290', 'volume_size': 1, 'snapshot_id': 'fe77400c-0c93-423e-9999-886d01ec0ff5'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3223c1-4e6e-4a92-929a-29aa93d354d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:43 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Volume volume-efe89a7f-08e6-4a89-a49b-003e418e9290 (efe89a7f-08e6-4a89-a49b-003e418e9290): created successfully
Sep 23 00:30:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3223c1-4e6e-4a92-929a-29aa93d354d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Flow 'volume_create_manager' (dfab5d06-e0d8-4d85-93b0-91bb7b1c24e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b6be8047-8bfd-4c6a-a4bc-9e32fbb1a141 tempest-TestStampPattern-1289715986 None] Created volume successfully.
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Flow 'volume_create_manager' (0a704f61-eb48-425d-8f94-81917f75742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ad576d-c5b0-4f45-84d9-7912e557d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ad576d-c5b0-4f45-84d9-7912e557d611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1735358695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a4d18f-61cf-4192-b16c-eb115f4e5290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c692ce17a4c5885eff35a8c1c04ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:51Z,use_quota=True,user_id='7f002e099e3e48278ff5abecfef52c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0b8ca-6b55-4cec-bb2e-473c95ed1736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0b8ca-6b55-4cec-bb2e-473c95ed1736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f108892-9d73-421a-9db3-93b41cceaf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f108892-9d73-421a-9db3-93b41cceaf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a4d18f-61cf-4192-b16c-eb115f4e5290', 'volume_name': 'volume-79a4d18f-61cf-4192-b16c-eb115f4e5290', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc4c110-f950-4ba6-97bc-f0c8092bc118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc4c110-f950-4ba6-97bc-f0c8092bc118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c90b6af-2b3c-462a-a471-f7d823a4816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:51 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Volume 79a4d18f-61cf-4192-b16c-eb115f4e5290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a4d18f-61cf-4192-b16c-eb115f4e5290', 'volume_size': 1}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1735358695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a4d18f-61cf-4192-b16c-eb115f4e5290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c692ce17a4c5885eff35a8c1c04ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:51Z,use_quota=True,user_id='7f002e099e3e48278ff5abecfef52c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Creating volume 79a4d18f-61cf-4192-b16c-eb115f4e5290 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:30:51 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:51 devstack sudo[104709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 1073741824
Sep 23 00:30:51 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:51 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 1073741824" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:52 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290
Sep 23 00:30:52 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:52 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290" returned: 0 in 0.290s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c90b6af-2b3c-462a-a471-f7d823a4816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a4d18f-61cf-4192-b16c-eb115f4e5290', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd038372-3b21-4e0e-9eb0-c29462c65325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:30:52 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Volume volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 (79a4d18f-61cf-4192-b16c-eb115f4e5290): created successfully
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd038372-3b21-4e0e-9eb0-c29462c65325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:30:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Flow 'volume_create_manager' (0a704f61-eb48-425d-8f94-81917f75742e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:30:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a2fa99c5-ac5a-4efb-b018-8276b9fb31ef tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Created volume successfully.
Sep 23 00:30:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8ef70f31-f663-4b58-8c45-ad8d28a22c77 req-84d98da4-2fb6-42a7-b055-1f8d2ed51249 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8ef70f31-f663-4b58-8c45-ad8d28a22c77 req-84d98da4-2fb6-42a7-b055-1f8d2ed51249 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-8ef70f31-f663-4b58-8c45-ad8d28a22c77 req-84d98da4-2fb6-42a7-b055-1f8d2ed51249 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:54 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-8ef70f31-f663-4b58-8c45-ad8d28a22c77 req-84d98da4-2fb6-42a7-b055-1f8d2ed51249 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-79a4d18f-61cf-4192-b16c-eb115f4e5290', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9efdaa6-27df-4d2b-9e39-e97b0d8262b8', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:30:54 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-8ef70f31-f663-4b58-8c45-ad8d28a22c77 req-84d98da4-2fb6-42a7-b055-1f8d2ed51249 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] attachment_update completed successfully.
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:57 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:30:57 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:57 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:30:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-d0c7f803-7579-4663-ae3e-76775a75a660 req-42a28392-6400-43da-aa3d-7116e8787baa tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Terminate volume connection completed successfully.
Sep 23 00:30:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-d0c7f803-7579-4663-ae3e-76775a75a660 req-42a28392-6400-43da-aa3d-7116e8787baa tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Deleting attachment b9efdaa6-27df-4d2b-9e39-e97b0d8262b8. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "cinder-79a4d18f-61cf-4192-b16c-eb115f4e5290-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "cinder-79a4d18f-61cf-4192-b16c-eb115f4e5290-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "cinder-quobyte-79a4d18f-61cf-4192-b16c-eb115f4e5290" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "cinder-quobyte-79a4d18f-61cf-4192-b16c-eb115f4e5290" acquired by "delete_volume" :: waited 0.015s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1cca30-df2d-4e09-8007-d5b53a4a18a3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:30:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:58 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290
Sep 23 00:30:58 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:59 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290" returned: 0 in 0.417s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:59 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290
Sep 23 00:30:59 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:30:59 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-79a4d18f-61cf-4192-b16c-eb115f4e5290" returned: 0 in 0.319s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "cinder-quobyte-79a4d18f-61cf-4192-b16c-eb115f4e5290" released by "delete_volume" :: held 0.783s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Created reservations ['8024461a-c9e6-43e8-81f3-7c5ed6c0441e', 'de867dd2-0a37-49ce-b599-6330548fe814', '0921a6e3-6b1a-408b-a12f-59554383b397', 'ef98e215-e17f-4110-ba22-bc1611d4cf36'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:30:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:30:59 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:30:59 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:00 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.299s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:00 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:00 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Deleted volume successfully.
Sep 23 00:31:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-cf2fc3e8-8e65-4926-a9af-a253dfb03c35 tempest-TestServerVolumeAttachScenarioOldVersion-482366891 None] Lock "cinder-79a4d18f-61cf-4192-b16c-eb115f4e5290-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:09 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=18,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:10 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:31:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-71f16cfa-4ca8-4ec0-9391-fa93f19f0829 req-d5583bd8-f83b-4f52-8187-a5918c9cecbc tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-71f16cfa-4ca8-4ec0-9391-fa93f19f0829 req-d5583bd8-f83b-4f52-8187-a5918c9cecbc tempest-TestStampPattern-1289715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [req-71f16cfa-4ca8-4ec0-9391-fa93f19f0829 req-d5583bd8-f83b-4f52-8187-a5918c9cecbc tempest-TestStampPattern-1289715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-71f16cfa-4ca8-4ec0-9391-fa93f19f0829 req-d5583bd8-f83b-4f52-8187-a5918c9cecbc tempest-TestStampPattern-1289715986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a', 'name': 'volume-efe89a7f-08e6-4a89-a49b-003e418e9290', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57cfaa0f-afba-4397-92fb-492211735895', 'enforce_multipath': True} {{(pid=86631) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 23 00:31:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-71f16cfa-4ca8-4ec0-9391-fa93f19f0829 req-d5583bd8-f83b-4f52-8187-a5918c9cecbc tempest-TestStampPattern-1289715986 None] attachment_update completed successfully.
Sep 23 00:31:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [req-3d2d0956-053d-4d58-90a0-5b4ce7c9db79 req-cea62a04-5160-48e0-bf7b-ccd07012f00c tempest-TestStampPattern-1289715986 None] Terminate volume connection completed successfully.
Sep 23 00:31:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [req-3d2d0956-053d-4d58-90a0-5b4ce7c9db79 req-cea62a04-5160-48e0-bf7b-ccd07012f00c tempest-TestStampPattern-1289715986 None] Deleting attachment 57cfaa0f-afba-4397-92fb-492211735895. {{(pid=86631) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-efe89a7f-08e6-4a89-a49b-003e418e9290-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "cinder-efe89a7f-08e6-4a89-a49b-003e418e9290-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db3c40e-e063-4b92-b4c6-6302ab436e75]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:34 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290
Sep 23 00:31:34 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:34 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290" returned: 0 in 0.416s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:34 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290
Sep 23 00:31:34 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:35 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-efe89a7f-08e6-4a89-a49b-003e418e9290" returned: 0 in 0.445s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-efe89a7f-08e6-4a89-a49b-003e418e9290" released by "delete_volume" :: held 0.918s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Created reservations ['89d82888-f7f7-4de4-b9ed-4f2ba5444163', '7d9a3bf4-e6a1-478b-9a61-1051ac8fe1e1', '7d3ad32f-93b4-4a01-af52-81a166f544c1', '5b97cfe1-147a-435f-9e25-780d89fec6f7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:35 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:31:35 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:35 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.275s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Deleted volume successfully.
Sep 23 00:31:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1f349012-33b8-42de-bd53-738e80a467af tempest-TestStampPattern-1289715986 None] Lock "cinder-efe89a7f-08e6-4a89-a49b-003e418e9290-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-fe77400c-0c93-423e-9999-886d01ec0ff5-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-fe77400c-0c93-423e-9999-886d01ec0ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Deleting offline snapshot fe77400c-0c93-423e-9999-886d01ec0ff5 of volume 93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] snapshot_file for this snap is: volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a324a-e935-4347-bed5-ebb74100d0bc]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:37 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:31:37 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:37 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.606s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93be0af4-9829-4878-8297-ad1d990b2bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d7324-d36e-44a7-9886-b62a2166f42a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:37 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:31:37 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:38 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.600s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:38 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:31:38 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:38 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.397s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:38 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5
Sep 23 00:31:38 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:39 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3.fe77400c-0c93-423e-9999-886d01ec0ff5" returned: 0 in 0.353s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-fe77400c-0c93-423e-9999-886d01ec0ff5" released by "_delete_snapshot" :: held 2.113s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" released by "delete_snapshot" :: held 2.144s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Created reservations ['43178939-3bb3-4ef0-b7cd-79cf609223f6', '8851d89a-d2f9-45ce-9bd6-d3848680e213', 'ea43e407-51dc-4431-ba8a-7922624f0f88', '603c2b0d-beb3-48e4-822d-f5dd1e6bb1af'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:31:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Delete snapshot completed successfully.
Sep 23 00:31:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f3f7798d-0300-450c-822e-2a52ca3b7a94 tempest-TestStampPattern-1289715986 None] Lock "cinder-fe77400c-0c93-423e-9999-886d01ec0ff5-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Flow 'volume_create_manager' (942dcefd-59c2-4ff0-a869-e87bad854c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59325c-c84b-4bad-8997-34e3429853e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59325c-c84b-4bad-8997-34e3429853e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-414659671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f77e4f-f38f-4251-9ad0-d009935940f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979361ce0abe45d0a2859afe1feed1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:41Z,use_quota=True,user_id='ebcfb71d59764604b4cc46d75a35fed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195733b4-b7d7-47bc-9a31-4d622bfd375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195733b4-b7d7-47bc-9a31-4d622bfd375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06ae480-c55d-41be-9e3b-f0396c2650f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06ae480-c55d-41be-9e3b-f0396c2650f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f77e4f-f38f-4251-9ad0-d009935940f5', 'volume_name': 'volume-23f77e4f-f38f-4251-9ad0-d009935940f5', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64568340-6b6b-4a28-b241-8cefc2486ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64568340-6b6b-4a28-b241-8cefc2486ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6a2fbb-5e57-4283-8352-347b29415eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Volume 23f77e4f-f38f-4251-9ad0-d009935940f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f77e4f-f38f-4251-9ad0-d009935940f5', 'volume_size': 1}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-414659671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f77e4f-f38f-4251-9ad0-d009935940f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='979361ce0abe45d0a2859afe1feed1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:41Z,use_quota=True,user_id='ebcfb71d59764604b4cc46d75a35fed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Creating volume 23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:31:41 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:41 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 1073741824
Sep 23 00:31:41 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:41 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 1073741824" returned: 0 in 0.624s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:41 devstack sudo[105783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:31:41 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:42 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6a2fbb-5e57-4283-8352-347b29415eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f77e4f-f38f-4251-9ad0-d009935940f5', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b22e012-3356-478a-89fa-01d3c6ab66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:31:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Volume volume-23f77e4f-f38f-4251-9ad0-d009935940f5 (23f77e4f-f38f-4251-9ad0-d009935940f5): created successfully
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b22e012-3356-478a-89fa-01d3c6ab66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:31:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Flow 'volume_create_manager' (942dcefd-59c2-4ff0-a869-e87bad854c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:31:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-522c0ddb-085b-4335-abdb-0003295afff8 tempest-TestImageHashVerification-1781884662 None] Created volume successfully.
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb956e7a-63a2-498c-a41a-2e50b887712e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:44 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:31:44 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:44 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.399s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[51172a3e-38a9-41e8-94af-64bd51ad326e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:44 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:31:44 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-93be0af4-9829-4878-8297-ad1d990b2bc3-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "cinder-93be0af4-9829-4878-8297-ad1d990b2bc3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Acquiring lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491042b-3f49-4cf9-974c-06b02f389dfb]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:45 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.468s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 /opt/stack/data/cinder/conversion/23f77e4f-f38f-4251-9ad0-d009935940f5.temp_image.aaef8546-6748-4e8d-9eb2-ab03ac466e5c7849yca1.img {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:45 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 /opt/stack/data/cinder/conversion/23f77e4f-f38f-4251-9ad0-d009935940f5.temp_image.aaef8546-6748-4e8d-9eb2-ab03ac466e5c7849yca1.img
Sep 23 00:31:45 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:45 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:31:45 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:45 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:45 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3
Sep 23 00:31:45 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:46 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-93be0af4-9829-4878-8297-ad1d990b2bc3" returned: 0 in 0.558s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "cinder-quobyte-93be0af4-9829-4878-8297-ad1d990b2bc3" released by "delete_volume" :: held 1.130s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Created reservations ['c07e80dc-f893-4798-9e4a-07f9867a0800', '8d993f81-54de-413b-bf2f-35ddae9e3595', 'ff652d98-54f0-4c40-9a6a-c5beb917b03c', '23db5ccd-a218-4416-9478-753edc269499'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:46 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:31:46 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:46 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.303s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Deleted volume successfully.
Sep 23 00:31:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b3583c89-d5da-4966-a11c-004718b7a8fe tempest-TestStampPattern-1289715986 None] Lock "cinder-93be0af4-9829-4878-8297-ad1d990b2bc3-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:31:52 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 /opt/stack/data/cinder/conversion/23f77e4f-f38f-4251-9ad0-d009935940f5.temp_image.aaef8546-6748-4e8d-9eb2-ab03ac466e5c7849yca1.img" returned: 0 in 7.207s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:52 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0402d5-6407-4d49-a68b-77856c705538]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:31:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:52 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:31:52 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:53 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.591s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:53 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/conversion/23f77e4f-f38f-4251-9ad0-d009935940f5.temp_image.aaef8546-6748-4e8d-9eb2-ab03ac466e5c7849yca1.img {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:31:53 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Converted 1024.00 MB image at 142.06 MB/s
Sep 23 00:31:53 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] aaef8546-6748-4e8d-9eb2-ab03ac466e5c was raw, no need to convert to raw {{(pid=86631) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:31:57 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:31:57 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:31:57 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.330s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:31:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:32:03 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:32:03 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=32,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (35c56f1a-328f-449b-87bf-8b23f57472f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92257622-6398-45a3-aa6f-82fd4b52125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92257622-6398-45a3-aa6f-82fd4b52125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154848700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef73b36-c993-44f0-be51-25b545939836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:06Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d57b8e-d9cc-4a5d-ba17-2e1e48fecdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d57b8e-d9cc-4a5d-ba17-2e1e48fecdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06fa41f-866d-476f-82e7-cd27ff28ab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06fa41f-866d-476f-82e7-cd27ff28ab24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef73b36-c993-44f0-be51-25b545939836', 'volume_name': 'volume-6ef73b36-c993-44f0-be51-25b545939836', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583ba783-1c31-400e-93d0-75381f144c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583ba783-1c31-400e-93d0-75381f144c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac93af83-8bde-415f-83b5-3f5f6deec874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Volume 6ef73b36-c993-44f0-be51-25b545939836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef73b36-c993-44f0-be51-25b545939836', 'volume_size': 1}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (43ab6aea-f2e2-468c-a738-e2308fa5e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9a241f-1459-4145-a607-18554779ae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9a241f-1459-4145-a607-18554779ae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1805459572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c12656-9a80-4dcc-8593-2b1c70771085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da710b-cf1b-4bf9-80a6-9f9a6a74da4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da710b-cf1b-4bf9-80a6-9f9a6a74da4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b245a2b6-0439-49b3-b3de-5f3db44f92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b245a2b6-0439-49b3-b3de-5f3db44f92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c12656-9a80-4dcc-8593-2b1c70771085', 'volume_name': 'volume-14c12656-9a80-4dcc-8593-2b1c70771085', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b84389-e807-434b-b683-78a2b66d6adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b84389-e807-434b-b683-78a2b66d6adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac9f62-fe3d-40a6-98db-ea11ef3b0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Volume 14c12656-9a80-4dcc-8593-2b1c70771085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c12656-9a80-4dcc-8593-2b1c70771085', 'volume_size': 1}
Sep 23 00:32:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (5c94d457-67e8-4dd3-b515-c14ebcafe83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a23679-57fc-4058-8a7b-a30b42213ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a23679-57fc-4058-8a7b-a30b42213ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155980825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18c104-f750-493d-a92e-781aa17e0536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d8e6f0-6c8e-4a85-a02f-d401f6dbe15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d8e6f0-6c8e-4a85-a02f-d401f6dbe15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64120074-fbf4-4c65-a9f4-3ca84835e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64120074-fbf4-4c65-a9f4-3ca84835e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c18c104-f750-493d-a92e-781aa17e0536', 'volume_name': 'volume-7c18c104-f750-493d-a92e-781aa17e0536', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78520eee-2c16-427a-b926-69bb02c818b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78520eee-2c16-427a-b926-69bb02c818b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad56024c-3ba2-444b-b3aa-87e41d4bbeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Volume 7c18c104-f750-493d-a92e-781aa17e0536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c18c104-f750-493d-a92e-781aa17e0536', 'volume_size': 1}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (e736995d-0dcf-4bca-873b-d45410c5dcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e0ff31-c279-4ca4-acbc-267bfb5446b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e0ff31-c279-4ca4-acbc-267bfb5446b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3544398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cee87ac-6308-4720-885b-b86985f73a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b892d397-d5e4-417e-a21d-dce4ae67771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b892d397-d5e4-417e-a21d-dce4ae67771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9266362-4887-4595-aeb7-c06ece8e5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9266362-4887-4595-aeb7-c06ece8e5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cee87ac-6308-4720-885b-b86985f73a1f', 'volume_name': 'volume-7cee87ac-6308-4720-885b-b86985f73a1f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b119b1-269b-4ad8-91f5-dd20e37682ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b119b1-269b-4ad8-91f5-dd20e37682ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dea08d-6fdf-4419-9193-48ca719f1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Volume 7cee87ac-6308-4720-885b-b86985f73a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cee87ac-6308-4720-885b-b86985f73a1f', 'volume_size': 1}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (f624291a-9a56-46cb-b6f7-afc40efc5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5dbfc4-417c-4ee1-b680-1f533a92e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5dbfc4-417c-4ee1-b680-1f533a92e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146909547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cd18ea-056e-43d9-a3d4-e1a012d031ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b40dc4-ede2-4739-8fef-54b607e7f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b40dc4-ede2-4739-8fef-54b607e7f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e9e612-6774-4774-a1ba-74a256691a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e9e612-6774-4774-a1ba-74a256691a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3cd18ea-056e-43d9-a3d4-e1a012d031ba', 'volume_name': 'volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc90508-6b23-47a4-8119-5741f4d71cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc90508-6b23-47a4-8119-5741f4d71cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd612e85-54cb-4fa0-8f20-abbcf826f1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Volume b3cd18ea-056e-43d9-a3d4-e1a012d031ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba', 'volume_size': 1}
Sep 23 00:32:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.215s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Uploaded volume to glance image-id: aaef8546-6748-4e8d-9eb2-ab03ac466e5c. {{(pid=86631) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.942s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154848700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef73b36-c993-44f0-be51-25b545939836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:06Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Creating volume 6ef73b36-c993-44f0-be51-25b545939836 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:15 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:15 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 1073741824
Sep 23 00:32:15 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8402ace7-dfbb-4333-8d86-9f3e391eb2fd tempest-TestImageHashVerification-1781884662 None] Copy volume to image completed successfully.
Sep 23 00:32:16 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 1073741824" returned: 0 in 0.514s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:16 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836
Sep 23 00:32:16 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:16 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836" returned: 0 in 0.279s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.452s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1805459572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c12656-9a80-4dcc-8593-2b1c70771085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Creating volume 14c12656-9a80-4dcc-8593-2b1c70771085 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:16 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Acquiring lock "cinder-23f77e4f-f38f-4251-9ad0-d009935940f5-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:16 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 1073741824
Sep 23 00:32:16 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac93af83-8bde-415f-83b5-3f5f6deec874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef73b36-c993-44f0-be51-25b545939836', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac1bbdc-c293-4398-9c42-57907782c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:16 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Volume volume-6ef73b36-c993-44f0-be51-25b545939836 (6ef73b36-c993-44f0-be51-25b545939836): created successfully
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac1bbdc-c293-4398-9c42-57907782c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (35c56f1a-328f-449b-87bf-8b23f57472f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "cinder-23f77e4f-f38f-4251-9ad0-d009935940f5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f2ea237a-1192-4e91-9e67-ac2bdb4609b1 tempest-CreateVolumesFromImageTest-691072647 None] Created volume successfully.
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Acquiring lock "cinder-quobyte-23f77e4f-f38f-4251-9ad0-d009935940f5" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "cinder-quobyte-23f77e4f-f38f-4251-9ad0-d009935940f5" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8d098-6c77-4715-8e76-88b9cb417361]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:16 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:32:16 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:16 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 1073741824" returned: 0 in 0.560s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:17 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.420s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085
Sep 23 00:32:17 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:17 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5
Sep 23 00:32:17 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:17 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085" returned: 0 in 0.311s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.916s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155980825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18c104-f750-493d-a92e-781aa17e0536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Creating volume 7c18c104-f750-493d-a92e-781aa17e0536 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:17 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-23f77e4f-f38f-4251-9ad0-d009935940f5" returned: 0 in 0.306s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac9f62-fe3d-40a6-98db-ea11ef3b0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c12656-9a80-4dcc-8593-2b1c70771085', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:17 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 1073741824
Sep 23 00:32:17 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3e44d0-5717-4d88-87a0-b7ea196eec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "cinder-quobyte-23f77e4f-f38f-4251-9ad0-d009935940f5" released by "delete_volume" :: held 0.836s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Volume volume-14c12656-9a80-4dcc-8593-2b1c70771085 (14c12656-9a80-4dcc-8593-2b1c70771085): created successfully
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3e44d0-5717-4d88-87a0-b7ea196eec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (43ab6aea-f2e2-468c-a738-e2308fa5e194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-aa73ec4e-4561-4b75-a5a6-a0a1b4b3a97f tempest-CreateVolumesFromImageTest-691072647 None] Created volume successfully.
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Created reservations ['027b7ae4-4225-406b-9bac-62d5a9a69a09', '67f29506-74a1-48a1-bc72-2fbcad1d30e9', 'ece44bd0-f6da-4215-93de-40142a83d4ad', '7fab17b5-f073-4bf5-b263-729dcff57f31'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:17 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:17 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:17 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.269s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Deleted volume successfully.
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f792311a-5bc5-4ed6-ae85-401672e1b114 tempest-TestImageHashVerification-1781884662 None] Lock "cinder-23f77e4f-f38f-4251-9ad0-d009935940f5-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:17 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 1073741824" returned: 0 in 0.563s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:17 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536
Sep 23 00:32:17 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:18 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536" returned: 0 in 0.284s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.255s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3544398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cee87ac-6308-4720-885b-b86985f73a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Creating volume 7cee87ac-6308-4720-885b-b86985f73a1f {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:18 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad56024c-3ba2-444b-b3aa-87e41d4bbeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c18c104-f750-493d-a92e-781aa17e0536', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:18 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f 1073741824
Sep 23 00:32:18 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8ca11a-5e41-47f4-89e5-ba41c585dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:18 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Volume volume-7c18c104-f750-493d-a92e-781aa17e0536 (7c18c104-f750-493d-a92e-781aa17e0536): created successfully
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8ca11a-5e41-47f4-89e5-ba41c585dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (5c94d457-67e8-4dd3-b515-c14ebcafe83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b1cf3b0e-0495-4db3-9a13-dace04e932b8 tempest-CreateVolumesFromImageTest-691072647 None] Created volume successfully.
Sep 23 00:32:18 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f 1073741824" returned: 0 in 0.508s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:18 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f
Sep 23 00:32:18 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:19 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f" returned: 0 in 0.276s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.817s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146909547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cd18ea-056e-43d9-a3d4-e1a012d031ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924e2497618f4a16bf453c40d41ae0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='da5695dbc80e4e4e9916942b3322447d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Creating volume b3cd18ea-056e-43d9-a3d4-e1a012d031ba {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dea08d-6fdf-4419-9193-48ca719f1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cee87ac-6308-4720-885b-b86985f73a1f', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fddbeec-3ddf-4ec7-bfd8-63af29c5aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:19 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba 1073741824
Sep 23 00:32:19 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Volume volume-7cee87ac-6308-4720-885b-b86985f73a1f (7cee87ac-6308-4720-885b-b86985f73a1f): created successfully
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fddbeec-3ddf-4ec7-bfd8-63af29c5aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (e736995d-0dcf-4bca-873b-d45410c5dcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-88f3ba33-5ff7-46f6-80a6-fc0a11a720c3 tempest-CreateVolumesFromImageTest-691072647 None] Created volume successfully.
Sep 23 00:32:19 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba 1073741824" returned: 0 in 0.583s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:19 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba
Sep 23 00:32:19 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:20 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" returned: 0 in 0.268s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd612e85-54cb-4fa0-8f20-abbcf826f1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d2a73a-0a31-40ad-969d-1b6a46654108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Volume volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba (b3cd18ea-056e-43d9-a3d4-e1a012d031ba): created successfully
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d2a73a-0a31-40ad-969d-1b6a46654108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Flow 'volume_create_manager' (f624291a-9a56-46cb-b6f7-afc40efc5a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-32f8e1e9-9409-4946-a864-cb1a6900744f tempest-CreateVolumesFromImageTest-691072647 None] Created volume successfully.
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-b3cd18ea-056e-43d9-a3d4-e1a012d031ba-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-b3cd18ea-056e-43d9-a3d4-e1a012d031ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-quobyte-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf145ce-e26c-49b6-a21c-a7a23d847aca]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:20 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba
Sep 23 00:32:20 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:20 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" returned: 0 in 0.438s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:20 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba
Sep 23 00:32:20 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:21 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-b3cd18ea-056e-43d9-a3d4-e1a012d031ba" released by "delete_volume" :: held 0.786s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Created reservations ['ca4b0571-2626-49dd-b6c1-c93b730823c2', '15c00719-ab42-4d57-9a91-e55f965d0796', '85082c9e-8921-4f08-8d25-57e074806d9a', '9e466705-ad3b-467c-b509-3dc4e36b1c4e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:21 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:21 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-7cee87ac-6308-4720-885b-b86985f73a1f-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-7cee87ac-6308-4720-885b-b86985f73a1f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-quobyte-7cee87ac-6308-4720-885b-b86985f73a1f" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-7cee87ac-6308-4720-885b-b86985f73a1f" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b1c1e-27f8-4616-863e-e52ea40804be]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:21 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.390s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Deleted volume successfully.
Sep 23 00:32:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7862462e-f84c-4089-abf1-59ea2193d6db tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-b3cd18ea-056e-43d9-a3d4-e1a012d031ba-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:21 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f
Sep 23 00:32:21 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:22 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:22 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f
Sep 23 00:32:22 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:22 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7cee87ac-6308-4720-885b-b86985f73a1f" returned: 0 in 0.263s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-7cee87ac-6308-4720-885b-b86985f73a1f" released by "delete_volume" :: held 0.799s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Created reservations ['80fbfb30-ff2a-4b86-ac22-20a128aa8807', 'ec10b998-d030-4bd8-9508-0c4b77aa9177', '66fe16b9-b7e3-4b0d-a4cf-07fa350ad5c3', '90c83f98-1db8-46a5-a06b-006066f9a7cb'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:22 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:22 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-7c18c104-f750-493d-a92e-781aa17e0536-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-7c18c104-f750-493d-a92e-781aa17e0536-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-quobyte-7c18c104-f750-493d-a92e-781aa17e0536" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-7c18c104-f750-493d-a92e-781aa17e0536" acquired by "delete_volume" :: waited 0.041s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b98be8-7a76-4c3d-a18f-803ef32092a6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.419s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:23 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Deleted volume successfully.
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d6139dd4-83f4-494d-9fb5-f30883d4dbfe tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-7cee87ac-6308-4720-885b-b86985f73a1f-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:23 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536
Sep 23 00:32:23 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:23 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536" returned: 0 in 0.488s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536
Sep 23 00:32:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:23 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7c18c104-f750-493d-a92e-781aa17e0536" returned: 0 in 0.291s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-7c18c104-f750-493d-a92e-781aa17e0536" released by "delete_volume" :: held 0.854s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Created reservations ['a9312885-9bc5-4632-8fde-56674569488d', 'b14054f6-dff2-4a19-8098-f3dd959ec8e6', 'c423cfde-f960-47b8-b70a-abdcfc577edf', '6a936332-effc-45b4-9ac5-ecc757444d69'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:23 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:23 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-14c12656-9a80-4dcc-8593-2b1c70771085-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-14c12656-9a80-4dcc-8593-2b1c70771085-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-quobyte-14c12656-9a80-4dcc-8593-2b1c70771085" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-14c12656-9a80-4dcc-8593-2b1c70771085" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[725be065-a7fe-4e2d-8236-810f6e2cc1f0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:24 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.433s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Deleted volume successfully.
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2d8307ef-73fd-4844-9078-1b8d01ce3a3f tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-7c18c104-f750-493d-a92e-781aa17e0536-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:24 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085
Sep 23 00:32:24 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:24 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085" returned: 0 in 0.407s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:24 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085
Sep 23 00:32:24 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-14c12656-9a80-4dcc-8593-2b1c70771085" returned: 0 in 0.265s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-14c12656-9a80-4dcc-8593-2b1c70771085" released by "delete_volume" :: held 0.725s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Created reservations ['94fc2496-048f-4527-b5e2-0327c74d180a', 'e5970cce-0bf4-4f88-8695-b50c2e005e1c', 'fa006c3f-544a-427a-bd56-b5bedc382fa2', 'fa566368-533b-4f49-b1bd-638be610068e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:25 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:25 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-6ef73b36-c993-44f0-be51-25b545939836-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-6ef73b36-c993-44f0-be51-25b545939836-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "cinder-quobyte-6ef73b36-c993-44f0-be51-25b545939836" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:25 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-6ef73b36-c993-44f0-be51-25b545939836" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Deleted volume successfully.
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7750d3-a860-408c-a4c3-ca9d7db1ff49]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d08a319e-8860-4318-900c-f00e514ee7e8 tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-14c12656-9a80-4dcc-8593-2b1c70771085-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:25 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836
Sep 23 00:32:25 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836" returned: 0 in 0.434s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836
Sep 23 00:32:26 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6ef73b36-c993-44f0-be51-25b545939836" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-quobyte-6ef73b36-c993-44f0-be51-25b545939836" released by "delete_volume" :: held 0.806s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Created reservations ['5099cbaf-a1f3-44d8-94a3-75940968f483', '400d05ef-4f89-4442-a2f0-5af12dbc16ba', '6cd39130-c2e4-44d2-9275-6dd9f1fb2c38', '8cf3cf26-b4a5-4c9b-83ab-3528ba4a54b7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:26 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:26 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:26 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.326s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Deleted volume successfully.
Sep 23 00:32:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-59448559-a07f-4f88-ac95-024034ae931b tempest-CreateVolumesFromImageTest-691072647 None] Lock "cinder-6ef73b36-c993-44f0-be51-25b545939836-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Flow 'volume_create_manager' (7de633dd-e717-469d-b4f5-5d9fc06043f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766ca52e-5f10-4a5c-9175-f47c849aaa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766ca52e-5f10-4a5c-9175-f47c849aaa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-101364971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2a034a-c09f-432c-b0cd-09a55b44c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630b474283b43fbb6d2b9ca7c449ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='5d341dd9a73b466fa91a535adb75e892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b327e38-13ef-46b1-88eb-c25152bea65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b327e38-13ef-46b1-88eb-c25152bea65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9868c10e-93d6-47f1-9d6e-2ceb32311ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9868c10e-93d6-47f1-9d6e-2ceb32311ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2a034a-c09f-432c-b0cd-09a55b44c2fc', 'volume_name': 'volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9b0f9e-3363-4711-b56c-4c55d21fcdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9b0f9e-3363-4711-b56c-4c55d21fcdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a8d448-2f6c-4eba-b7ee-fe2ae5dbc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Volume 3e2a034a-c09f-432c-b0cd-09a55b44c2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc', 'volume_size': 1}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-101364971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2a034a-c09f-432c-b0cd-09a55b44c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630b474283b43fbb6d2b9ca7c449ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='5d341dd9a73b466fa91a535adb75e892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Creating volume 3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:32:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:34 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc 1073741824
Sep 23 00:32:34 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:35 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc 1073741824" returned: 0 in 0.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:35 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:35 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:35 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.345s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a8d448-2f6c-4eba-b7ee-fe2ae5dbc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:35 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b020df2a-4d16-4044-a9b1-9f91bcb082ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Volume volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc (3e2a034a-c09f-432c-b0cd-09a55b44c2fc): created successfully
Sep 23 00:32:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b020df2a-4d16-4044-a9b1-9f91bcb082ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Flow 'volume_create_manager' (7de633dd-e717-469d-b4f5-5d9fc06043f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8c6e28e9-4bef-4b2d-a4e5-a5f148d05199 tempest-VolumeDependencyTests-1876782451 None] Created volume successfully.
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Creating offline snapshot 28a938f4-5225-40fb-8bbf-24c6663095fd of volume 3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327c21a-88fd-4513-8ea7-830baaf24d04]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:37 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:37 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:37 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.535s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:37 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd 1G
Sep 23 00:32:37 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:38 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd 1G" returned: 0 in 0.641s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:38 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:38 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:38 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.360s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:38 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd is being set with open permissions: ugo+rw
Sep 23 00:32:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:38 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:38 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.328s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:39 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info
Sep 23 00:32:39 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:39 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info is being set with open permissions: ugo+rw
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:39 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info
Sep 23 00:32:39 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:39 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.info" returned: 0 in 0.300s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c3d7ac5c-f030-4ae2-af3a-c6dcf7a086e0 tempest-VolumeDependencyTests-1876782451 None] Create snapshot completed successfully
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Flow 'volume_create_manager' (8f04a998-97e3-4805-800f-bd66ab6f2c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a275d-402b-4acc-a8cd-122501509032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a275d-402b-4acc-a8cd-122501509032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-637318031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e40102b-97e4-4109-9f96-c6880d3cf0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630b474283b43fbb6d2b9ca7c449ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28a938f4-5225-40fb-8bbf-24c6663095fd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:41Z,use_quota=True,user_id='5d341dd9a73b466fa91a535adb75e892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79729e8c-4e92-4d97-a241-d3b42070154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79729e8c-4e92-4d97-a241-d3b42070154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c4aa8b-76a1-4464-b862-066f9e982c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c4aa8b-76a1-4464-b862-066f9e982c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e40102b-97e4-4109-9f96-c6880d3cf0d4', 'volume_name': 'volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4', 'volume_size': 1, 'snapshot_id': '28a938f4-5225-40fb-8bbf-24c6663095fd'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7e3014-1f50-40c9-8171-de823784e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7e3014-1f50-40c9-8171-de823784e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de72b00-7cf6-4f01-8d76-240544b1ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Volume 9e40102b-97e4-4109-9f96-c6880d3cf0d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4', 'volume_size': 1, 'snapshot_id': '28a938f4-5225-40fb-8bbf-24c6663095fd'}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd-9e40102b-97e4-4109-9f96-c6880d3cf0d4" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd-9e40102b-97e4-4109-9f96-c6880d3cf0d4" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Creating volume 9e40102b-97e4-4109-9f96-c6880d3cf0d4 from snapshot 28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] snapshot: 28a938f4-5225-40fb-8bbf-24c6663095fd, volume: 9e40102b-97e4-4109-9f96-c6880d3cf0d4,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed42787b-8ac3-41a6-b275-00d0ba60c158]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:41 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:41 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:41 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.479s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc33ce-ab70-486b-a6b6-885e6378e66f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:41 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:41 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:42 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.475s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:32:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:32:42 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:32:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:42 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4
Sep 23 00:32:42 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:50 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4" returned: 0 in 8.138s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:32:50 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Converted 1024.00 MB image at 125.78 MB/s
Sep 23 00:32:50 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 is being set with open permissions: ugo+rw
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:50 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4
Sep 23 00:32:50 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:50 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" released by "_copy_volume_from_snapshot" :: held 9.580s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd-9e40102b-97e4-4109-9f96-c6880d3cf0d4" released by "_create_volume_from_snapshot" :: held 9.687s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.711s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de72b00-7cf6-4f01-8d76-240544b1ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4', 'volume_size': 1, 'snapshot_id': '28a938f4-5225-40fb-8bbf-24c6663095fd'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7d27fb-8932-45c0-9506-99c8ba9f3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:32:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Volume volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 (9e40102b-97e4-4109-9f96-c6880d3cf0d4): created successfully
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7d27fb-8932-45c0-9506-99c8ba9f3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:32:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Flow 'volume_create_manager' (8f04a998-97e3-4805-800f-bd66ab6f2c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:32:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-83185958-a0f2-487a-acab-bb07fc2a018f tempest-VolumeDependencyTests-1876782451 None] Created volume successfully.
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-28a938f4-5225-40fb-8bbf-24c6663095fd-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-28a938f4-5225-40fb-8bbf-24c6663095fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Deleting offline snapshot 28a938f4-5225-40fb-8bbf-24c6663095fd of volume 3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] snapshot_file for this snap is: volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d56be06-64fa-480e-92b6-05226ed5a514]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:51 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:51 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:51 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.480s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef3625-6607-4c7e-a9b2-21d04958554a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:52 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:52 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:52 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.863s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:52 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:52 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:53 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.420s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:53 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd
Sep 23 00:32:53 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:53 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc.28a938f4-5225-40fb-8bbf-24c6663095fd" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-28a938f4-5225-40fb-8bbf-24c6663095fd" released by "_delete_snapshot" :: held 2.235s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" released by "delete_snapshot" :: held 2.266s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Created reservations ['95673c15-f489-4060-b39a-c0359cdcabdc', '2529d7b9-f391-4944-a53e-af7c47af7b07', 'ea4a6d4a-bf52-489f-8e52-0ebbebfeda8b', 'f1e8ea31-bd99-4ac2-bd78-47fe2c942a19'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:53 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Delete snapshot completed successfully.
Sep 23 00:32:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-777d9e50-22ef-4fe4-9f0d-69e4acce8042 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-28a938f4-5225-40fb-8bbf-24c6663095fd-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-3e2a034a-c09f-432c-b0cd-09a55b44c2fc-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-3e2a034a-c09f-432c-b0cd-09a55b44c2fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c1c39-2667-4cff-88c4-e9eca6bb0f91]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:54 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:54 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:55 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:55 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc
Sep 23 00:32:55 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:55 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" returned: 0 in 0.307s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-3e2a034a-c09f-432c-b0cd-09a55b44c2fc" released by "delete_volume" :: held 0.869s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Created reservations ['7d955e3a-7203-443a-8c1c-7fd1dedcf1f0', '97b94b54-a8d2-46b5-90c9-c767c17831c8', 'ee752c08-2e2f-4ecb-b846-74c70aba5884', 'ba3bbc13-d8fe-4395-b373-9b9552be4bee'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:55 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:55 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-9e40102b-97e4-4109-9f96-c6880d3cf0d4-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-9e40102b-97e4-4109-9f96-c6880d3cf0d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:32:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b94d106-de0e-490b-8ad2-3a9743e3402a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:56 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.414s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Deleted volume successfully.
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e8099b51-5a7d-42b1-b9a7-71ca1280e9a0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-3e2a034a-c09f-432c-b0cd-09a55b44c2fc-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:56 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4
Sep 23 00:32:56 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4" returned: 0 in 0.521s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:56 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4
Sep 23 00:32:56 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:56 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9e40102b-97e4-4109-9f96-c6880d3cf0d4" returned: 0 in 0.397s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-quobyte-9e40102b-97e4-4109-9f96-c6880d3cf0d4" released by "delete_volume" :: held 1.058s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:32:57 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:57 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Created reservations ['54f8c9af-4d9e-4d71-90d2-c733002585a3', '53753fa8-de1b-47e4-9aa2-33a9851a153d', 'ba7d901d-4e88-4b19-ba51-b2cd5c633230', '985cb754-483c-405c-ad17-90e4a2575ce4'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:32:57 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:32:57 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:32:57 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:32:57 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.297s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:32:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Deleted volume successfully.
Sep 23 00:32:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c3b83905-530f-40f9-8ec5-8cb01590c0b0 tempest-VolumeDependencyTests-1876782451 None] Lock "cinder-9e40102b-97e4-4109-9f96-c6880d3cf0d4-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Flow 'volume_create_manager' (89ba9919-e731-47bf-8db5-8f74b83f8b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785dc02b-6b33-46b2-9e93-688e2538b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785dc02b-6b33-46b2-9e93-688e2538b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457dc05-53ca-465a-99f9-c4eef9e75d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d2f6fd0ce6445685483e25a6354757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:03Z,use_quota=True,user_id='085f0ade80b4424498c95ce1e3d96071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faed6aa1-de8f-465b-8c3e-c497d850bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faed6aa1-de8f-465b-8c3e-c497d850bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8130d8-6230-4537-b19c-b6aab97b1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8130d8-6230-4537-b19c-b6aab97b1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3457dc05-53ca-465a-99f9-c4eef9e75d71', 'volume_name': 'volume-3457dc05-53ca-465a-99f9-c4eef9e75d71', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7447a-feea-4d3a-82ad-5db3b1fb1dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7447a-feea-4d3a-82ad-5db3b1fb1dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca24ad8-b201-4032-80e9-8c5cd09043ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Volume 3457dc05-53ca-465a-99f9-c4eef9e75d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3457dc05-53ca-465a-99f9-c4eef9e75d71', 'volume_size': 1}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457dc05-53ca-465a-99f9-c4eef9e75d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d2f6fd0ce6445685483e25a6354757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:03Z,use_quota=True,user_id='085f0ade80b4424498c95ce1e3d96071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Creating volume 3457dc05-53ca-465a-99f9-c4eef9e75d71 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:02 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:02 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 1073741824
Sep 23 00:33:02 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:03 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 1073741824" returned: 0 in 0.657s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:03 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=60,cinder:UPDATE=101,cinder:INSERT=18,cinder:DELETE=9 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:33:03 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=86,cinder:SELECT=73,cinder:DELETE=7,cinder:INSERT=26 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:33:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:03 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71
Sep 23 00:33:03 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:04 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71" returned: 0 in 0.361s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca24ad8-b201-4032-80e9-8c5cd09043ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3457dc05-53ca-465a-99f9-c4eef9e75d71', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e91c5a8-350f-484f-a934-f44aef37a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:04 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Volume volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 (3457dc05-53ca-465a-99f9-c4eef9e75d71): created successfully
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e91c5a8-350f-484f-a934-f44aef37a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Flow 'volume_create_manager' (89ba9919-e731-47bf-8db5-8f74b83f8b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:04 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6ce0f468-a98e-45dc-927b-13a1563c452f tempest-CinderUnicodeTest-328353537 None] Created volume successfully.
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Flow 'volume_create_manager' (55546386-0a91-4761-a3cf-671185c81da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cc2d4b-77b0-4452-bf49-2a746aa9f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cc2d4b-77b0-4452-bf49-2a746aa9f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-923265212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e098959-c187-4ce9-b6d8-0c133924dfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d2f6fd0ce6445685483e25a6354757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='085f0ade80b4424498c95ce1e3d96071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f306878-89a4-487f-8c11-221d588cc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f306878-89a4-487f-8c11-221d588cc407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20afa27-88bb-4500-bc94-b809d043d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20afa27-88bb-4500-bc94-b809d043d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e098959-c187-4ce9-b6d8-0c133924dfd6', 'volume_name': 'volume-4e098959-c187-4ce9-b6d8-0c133924dfd6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19e0fbb-849e-4824-af7b-828297b7b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19e0fbb-849e-4824-af7b-828297b7b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac687f8-7ede-46e4-aa72-f8e4f3ed812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Volume 4e098959-c187-4ce9-b6d8-0c133924dfd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e098959-c187-4ce9-b6d8-0c133924dfd6', 'volume_size': 1}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-923265212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e098959-c187-4ce9-b6d8-0c133924dfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d2f6fd0ce6445685483e25a6354757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='085f0ade80b4424498c95ce1e3d96071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Creating volume 4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:05 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:05 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 1073741824
Sep 23 00:33:05 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Flow 'volume_create_manager' (27a0caf0-7582-4cf2-94a3-f46838b5f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71f2476-d0db-4ab7-a716-6287b07f349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71f2476-d0db-4ab7-a716-6287b07f349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1054595739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ab919-9aee-4670-b55f-8a3c1b59e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b5d1010a1a47fda4e14b2f77bb2d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='cd43055f1cfd4dcc89b924d7c1d52681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26037da-f3fa-4fe4-980e-4b84f69cea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26037da-f3fa-4fe4-980e-4b84f69cea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4bfe51-6497-42a8-aa83-d34106733fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4bfe51-6497-42a8-aa83-d34106733fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872ab919-9aee-4670-b55f-8a3c1b59e165', 'volume_name': 'volume-872ab919-9aee-4670-b55f-8a3c1b59e165', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecfc52f-c522-4e93-8bcd-0ab8508e27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecfc52f-c522-4e93-8bcd-0ab8508e27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff10b53-1262-4d69-839f-21c3e23539bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Volume 872ab919-9aee-4670-b55f-8a3c1b59e165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872ab919-9aee-4670-b55f-8a3c1b59e165', 'volume_size': 1}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:06 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 1073741824" returned: 0 in 0.647s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:06 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6
Sep 23 00:33:06 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:06 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6" returned: 0 in 0.288s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1054595739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ab919-9aee-4670-b55f-8a3c1b59e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b5d1010a1a47fda4e14b2f77bb2d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='cd43055f1cfd4dcc89b924d7c1d52681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Creating volume 872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac687f8-7ede-46e4-aa72-f8e4f3ed812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e098959-c187-4ce9-b6d8-0c133924dfd6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:06 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 1073741824
Sep 23 00:33:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcf917f-4171-4dc4-a177-7cd087961d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:06 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Volume volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 (4e098959-c187-4ce9-b6d8-0c133924dfd6): created successfully
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcf917f-4171-4dc4-a177-7cd087961d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Flow 'volume_create_manager' (55546386-0a91-4761-a3cf-671185c81da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ef7c7c52-358f-41a6-a49e-be872cf36661 tempest-CinderUnicodeTest-328353537 None] Created volume successfully.
Sep 23 00:33:07 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 1073741824" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:07 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:07 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:07 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff10b53-1262-4d69-839f-21c3e23539bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872ab919-9aee-4670-b55f-8a3c1b59e165', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff444889-0e4a-46dd-9ddc-fd0b0c244e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Volume volume-872ab919-9aee-4670-b55f-8a3c1b59e165 (872ab919-9aee-4670-b55f-8a3c1b59e165): created successfully
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff444889-0e4a-46dd-9ddc-fd0b0c244e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Flow 'volume_create_manager' (27a0caf0-7582-4cf2-94a3-f46838b5f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2e137df2-16f8-4b57-949c-0db8b40bdabf tempest-SnapshotDependencyTests-2114187408 None] Created volume successfully.
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Creating offline snapshot 58dd876b-7e5c-42af-a6f9-35c308a9a180 of volume 4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cda7ad-ce48-4613-ae44-4432663f085b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:08 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6
Sep 23 00:33:08 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:08 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6" returned: 0 in 0.479s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:08 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 1G
Sep 23 00:33:08 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:09 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 1G" returned: 0 in 0.446s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180
Sep 23 00:33:09 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:09 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180" returned: 0 in 0.298s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 is being set with open permissions: ugo+rw
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180
Sep 23 00:33:09 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:09 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180" returned: 0 in 0.254s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info
Sep 23 00:33:09 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:09 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info" returned: 0 in 0.247s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:09 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info is being set with open permissions: ugo+rw
Sep 23 00:33:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:09 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info
Sep 23 00:33:09 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:10 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.info" returned: 0 in 0.285s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.546s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Creating offline snapshot 51e2a5ca-d897-45f9-b2f8-947a21c59b3c of volume 872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:33:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-70b19ddc-dba2-44d9-abe4-9aebc7ed9519 tempest-CinderUnicodeTest-328353537 None] Create snapshot completed successfully
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8731bf5-167c-4636-b818-df3594c35aba]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:10 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:10 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:10 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.445s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:10 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c 1G
Sep 23 00:33:10 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:11 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c 1G" returned: 0 in 0.501s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872ab919-9aee-4670-b55f-8a3c1b59e165 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:11 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872ab919-9aee-4670-b55f-8a3c1b59e165 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:11 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-58dd876b-7e5c-42af-a6f9-35c308a9a180-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-58dd876b-7e5c-42af-a6f9-35c308a9a180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-quobyte-58dd876b-7e5c-42af-a6f9-35c308a9a180" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-58dd876b-7e5c-42af-a6f9-35c308a9a180" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Deleting offline snapshot 58dd876b-7e5c-42af-a6f9-35c308a9a180 of volume 4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] snapshot_file for this snap is: volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b817f4f-db4d-4565-8534-439c8e555493]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:11 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180
Sep 23 00:33:11 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:11 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872ab919-9aee-4670-b55f-8a3c1b59e165 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.380s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:11 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c is being set with open permissions: ugo+rw
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:11 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:11 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.280s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:11 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180" returned: 0 in 0.458s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e098959-c187-4ce9-b6d8-0c133924dfd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8f54d8-8295-4189-a59f-d0dde848c65f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info
Sep 23 00:33:12 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6
Sep 23 00:33:12 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info is being set with open permissions: ugo+rw
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info
Sep 23 00:33:12 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6" returned: 0 in 0.467s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180
Sep 23 00:33:12 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:12 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.info" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2e227994-7d99-4841-9a2c-77cd99a3019c tempest-SnapshotDependencyTests-2114187408 None] Create snapshot completed successfully
Sep 23 00:33:12 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:12 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180
Sep 23 00:33:12 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:13 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6.58dd876b-7e5c-42af-a6f9-35c308a9a180" returned: 0 in 0.279s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-58dd876b-7e5c-42af-a6f9-35c308a9a180" released by "_delete_snapshot" :: held 1.744s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" released by "delete_snapshot" :: held 1.777s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Created reservations ['0aeafede-0eb8-4ad4-abd1-6f95db89add3', 'c5de2918-fa02-4f4e-b13d-ba84c5b6f8d9', '75fdb271-02cf-47af-b762-a40ed61b4a2b', '73923486-9086-4096-a3fc-774475620cb5'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Delete snapshot completed successfully.
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f9928288-6167-4ee0-8bc5-cfc59ac0097f tempest-CinderUnicodeTest-328353537 None] Lock "cinder-58dd876b-7e5c-42af-a6f9-35c308a9a180-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-4e098959-c187-4ce9-b6d8-0c133924dfd6-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-4e098959-c187-4ce9-b6d8-0c133924dfd6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Flow 'volume_create_manager' (5659f834-c147-490f-a299-e9bbe7e435c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef50904-5d2a-46f0-969d-c37210c2bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef50904-5d2a-46f0-969d-c37210c2bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b51488-ba32-4fb7-b040-7b612edc69f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b5d1010a1a47fda4e14b2f77bb2d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51e2a5ca-d897-45f9-b2f8-947a21c59b3c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:14Z,use_quota=True,user_id='cd43055f1cfd4dcc89b924d7c1d52681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2ac7fb-662c-490e-8e32-2b238d289cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2ac7fb-662c-490e-8e32-2b238d289cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792f4b5e-157d-40e3-9ea5-1399f1406ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792f4b5e-157d-40e3-9ea5-1399f1406ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5b51488-ba32-4fb7-b040-7b612edc69f6', 'volume_name': 'volume-f5b51488-ba32-4fb7-b040-7b612edc69f6', 'volume_size': 1, 'snapshot_id': '51e2a5ca-d897-45f9-b2f8-947a21c59b3c'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aec0e4-62de-4521-8736-41eee1460333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aec0e4-62de-4521-8736-41eee1460333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be340175-e0a5-47f8-9f1e-8a47a74e8400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:13 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Volume f5b51488-ba32-4fb7-b040-7b612edc69f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5b51488-ba32-4fb7-b040-7b612edc69f6', 'volume_size': 1, 'snapshot_id': '51e2a5ca-d897-45f9-b2f8-947a21c59b3c'}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-f5b51488-ba32-4fb7-b040-7b612edc69f6" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" acquired by "delete_volume" :: waited 0.062s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-f5b51488-ba32-4fb7-b040-7b612edc69f6" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Creating volume f5b51488-ba32-4fb7-b040-7b612edc69f6 from snapshot 51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0525fa8-9524-4973-b687-faa0481ba00b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] snapshot: 51e2a5ca-d897-45f9-b2f8-947a21c59b3c, volume: f5b51488-ba32-4fb7-b040-7b612edc69f6,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb9ce3-92ec-4b6d-94e0-5530a2885aef]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:13 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6
Sep 23 00:33:13 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:14 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6" returned: 0 in 0.406s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6
Sep 23 00:33:14 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.417s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-872ab919-9aee-4670-b55f-8a3c1b59e165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460d39d-5566-480c-a7e9-fc7b1100839f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:14 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4e098959-c187-4ce9-b6d8-0c133924dfd6" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-4e098959-c187-4ce9-b6d8-0c133924dfd6" released by "delete_volume" :: held 0.772s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Created reservations ['83f53431-8d33-4b10-a372-4543668357bd', '675cbd55-f315-4f88-9186-75a2055e4867', 'ea9a218c-42ca-4e26-9d07-bac17ae9b101', 'a82a1fa3-aaec-4149-9920-a3388ee2adec'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:14 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-3457dc05-53ca-465a-99f9-c4eef9e75d71-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.464s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-3457dc05-53ca-465a-99f9-c4eef9e75d71-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:14 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6
Sep 23 00:33:14 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "cinder-quobyte-3457dc05-53ca-465a-99f9-c4eef9e75d71" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-3457dc05-53ca-465a-99f9-c4eef9e75d71" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c2aa9-045a-423f-8708-1ee37940da38]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.371s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Deleted volume successfully.
Sep 23 00:33:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64afbc59-49a7-4b29-941d-e12668c2eda7 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-4e098959-c187-4ce9-b6d8-0c133924dfd6-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:15 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71
Sep 23 00:33:15 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71" returned: 0 in 0.517s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:15 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71
Sep 23 00:33:15 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:15 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3457dc05-53ca-465a-99f9-c4eef9e75d71" returned: 0 in 0.516s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-quobyte-3457dc05-53ca-465a-99f9-c4eef9e75d71" released by "delete_volume" :: held 1.112s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Created reservations ['a80be097-9392-496f-8089-33f45f5392a2', 'be996409-9b04-4ac4-a2b6-122cc2abc182', 'a503c488-f3fc-4234-92f9-f4833eb2007f', 'c0087be5-9d17-4769-a639-95838e38344f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:16 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:16 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:16 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.536s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Deleted volume successfully.
Sep 23 00:33:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3bb17c2e-6ecd-4a31-ad2d-3c9b8c6c74e6 tempest-CinderUnicodeTest-328353537 None] Lock "cinder-3457dc05-53ca-465a-99f9-c4eef9e75d71-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:22 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6" returned: 0 in 7.646s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:33:22 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Converted 1024.00 MB image at 133.90 MB/s
Sep 23 00:33:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 is being set with open permissions: ugo+rw
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:22 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6
Sep 23 00:33:22 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:22 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6" returned: 0 in 0.264s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" released by "_copy_volume_from_snapshot" :: held 8.909s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-f5b51488-ba32-4fb7-b040-7b612edc69f6" released by "_create_volume_from_snapshot" :: held 8.993s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.037s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be340175-e0a5-47f8-9f1e-8a47a74e8400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b51488-ba32-4fb7-b040-7b612edc69f6', 'volume_size': 1, 'snapshot_id': '51e2a5ca-d897-45f9-b2f8-947a21c59b3c'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce35b7a7-b60d-4243-acac-92fe1df77e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:22 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Volume volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 (f5b51488-ba32-4fb7-b040-7b612edc69f6): created successfully
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce35b7a7-b60d-4243-acac-92fe1df77e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Flow 'volume_create_manager' (5659f834-c147-490f-a299-e9bbe7e435c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3655c1f0-eb45-411c-8ee3-250e2e936abd tempest-SnapshotDependencyTests-2114187408 None] Created volume successfully.
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Deleting offline snapshot 51e2a5ca-d897-45f9-b2f8-947a21c59b3c of volume 872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] snapshot_file for this snap is: volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1653be-39e5-4368-ae12-ae12e766a529]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:23 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:23 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Flow 'volume_create_manager' (e7a3490f-d070-4067-9e27-d57af5912f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e15cc7-b01c-4fee-ade2-310d04455cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e15cc7-b01c-4fee-ade2-310d04455cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53016999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bedf59-b203-4745-9aac-9101c0a45d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff6ced655174a91b86f1918a81bcc11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='bd70565f8e114aeda553d88de44f8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26609d36-db97-4ef8-9238-61829675d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26609d36-db97-4ef8-9238-61829675d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0affae42-5f79-441b-af13-6e2196c8e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0affae42-5f79-441b-af13-6e2196c8e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bedf59-b203-4745-9aac-9101c0a45d40', 'volume_name': 'volume-c1bedf59-b203-4745-9aac-9101c0a45d40', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb2b57e-ad44-4775-83c3-a2cb635ef119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb2b57e-ad44-4775-83c3-a2cb635ef119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa95faf9-82bb-47e3-97d9-60d688fd6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:24 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Volume c1bedf59-b203-4745-9aac-9101c0a45d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bedf59-b203-4745-9aac-9101c0a45d40', 'volume_size': 1}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53016999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bedf59-b203-4745-9aac-9101c0a45d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff6ced655174a91b86f1918a81bcc11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='bd70565f8e114aeda553d88de44f8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Creating volume c1bedf59-b203-4745-9aac-9101c0a45d40 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:24 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:24 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 1073741824
Sep 23 00:33:24 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:24 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-872ab919-9aee-4670-b55f-8a3c1b59e165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335e11e-66ac-48e6-8c6b-d797ee0b4c23]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:24 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:24 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:24 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 1073741824" returned: 0 in 0.596s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:24 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40
Sep 23 00:33:24 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:24 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.627s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:24 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:24 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:24 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40" returned: 0 in 0.311s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa95faf9-82bb-47e3-97d9-60d688fd6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bedf59-b203-4745-9aac-9101c0a45d40', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9be224f-b478-497a-879c-853eb8fac9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Volume volume-c1bedf59-b203-4745-9aac-9101c0a45d40 (c1bedf59-b203-4745-9aac-9101c0a45d40): created successfully
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9be224f-b478-497a-879c-853eb8fac9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Flow 'volume_create_manager' (e7a3490f-d070-4067-9e27-d57af5912f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-176f91da-5f2a-4746-9486-5e3787334aa8 tempest-ProjectReaderTests-732852733 None] Created volume successfully.
Sep 23 00:33:25 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.393s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:25 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c
Sep 23 00:33:25 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:25 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165.51e2a5ca-d897-45f9-b2f8-947a21c59b3c" returned: 0 in 0.253s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-51e2a5ca-d897-45f9-b2f8-947a21c59b3c" released by "_delete_snapshot" :: held 1.851s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" released by "delete_snapshot" :: held 1.881s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Created reservations ['e36ae31d-98ac-4997-a854-1d8f97565582', '2f955062-1809-47e4-ae7b-f524bc473da8', '404dcc43-fab0-4db5-9f29-5ae9c6b83990', '2217ff88-5e57-40b4-8dea-a0f20e972104'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Delete snapshot completed successfully.
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e025df1b-4535-4a68-9798-84c90b145611 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-51e2a5ca-d897-45f9-b2f8-947a21c59b3c-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-872ab919-9aee-4670-b55f-8a3c1b59e165-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-872ab919-9aee-4670-b55f-8a3c1b59e165-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4cb8ab-7725-407b-bb1b-5e1942b7286e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:26 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:26 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Acquiring lock "cinder-c1bedf59-b203-4745-9aac-9101c0a45d40-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "cinder-c1bedf59-b203-4745-9aac-9101c0a45d40-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Acquiring lock "cinder-quobyte-c1bedf59-b203-4745-9aac-9101c0a45d40" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "cinder-quobyte-c1bedf59-b203-4745-9aac-9101c0a45d40" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcda9c2-3784-4f96-817d-d925d7eca7ec]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:26 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40
Sep 23 00:33:26 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:26 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.484s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:26 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165
Sep 23 00:33:26 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:26 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-872ab919-9aee-4670-b55f-8a3c1b59e165" returned: 0 in 0.269s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:26 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40" returned: 0 in 0.425s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-872ab919-9aee-4670-b55f-8a3c1b59e165" released by "delete_volume" :: held 0.840s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:26 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40
Sep 23 00:33:26 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Created reservations ['bc0a13dd-a5f9-4637-9a11-b9f0633711fc', 'e944b8f3-3786-42f2-8341-64c2875faaee', '4d492509-8d34-4b35-b33b-5b16d4be48e5', '792becdd-7481-4c4e-97db-45999027d069'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:27 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-f5b51488-ba32-4fb7-b040-7b612edc69f6-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:27 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c1bedf59-b203-4745-9aac-9101c0a45d40" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-f5b51488-ba32-4fb7-b040-7b612edc69f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "cinder-quobyte-c1bedf59-b203-4745-9aac-9101c0a45d40" released by "delete_volume" :: held 0.800s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c58586-c6a7-4a7d-9639-f2f1d5fcf278]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Created reservations ['d9c6df0c-3ac7-452a-bbd1-e2f26bec0d40', 'a7e3c8af-2abf-4d89-bc5c-7c0578cee6bf', '0e17534d-c829-47ca-9505-97a279782025', '2eb7efdb-5628-4a57-a423-acc6f1308e92'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:27 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Deleted volume successfully.
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-2ddd41b7-2de1-4419-a8c3-eefb5a3c34b1 tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-872ab919-9aee-4670-b55f-8a3c1b59e165-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6
Sep 23 00:33:27 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:27 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Deleted volume successfully.
Sep 23 00:33:27 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6" returned: 0 in 0.484s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0d13f667-0299-42da-8100-5aead7ca7233 tempest-ProjectReaderTests-732852733 None] Lock "cinder-c1bedf59-b203-4745-9aac-9101c0a45d40-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:27 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6
Sep 23 00:33:27 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:27 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Flow 'volume_create_manager' (99446b7d-7481-47c3-bf60-2d0ebba1d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e8ee40-0e1c-4a53-9ba6-e56db3945b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e8ee40-0e1c-4a53-9ba6-e56db3945b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102136900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f9deb5-8723-4031-8d12-4306f51dcdd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff6ced655174a91b86f1918a81bcc11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:28Z,use_quota=True,user_id='bd70565f8e114aeda553d88de44f8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e12a640-d0ec-4a25-9b54-c0d76312fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e12a640-d0ec-4a25-9b54-c0d76312fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaaaebb-3fdd-402c-8282-5236541880a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaaaebb-3fdd-402c-8282-5236541880a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f9deb5-8723-4031-8d12-4306f51dcdd7', 'volume_name': 'volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f62030-72f9-4e74-985e-df54ae249736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f62030-72f9-4e74-985e-df54ae249736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4559c2c-5781-44aa-b9e0-c843e01d3b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Volume a6f9deb5-8723-4031-8d12-4306f51dcdd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7', 'volume_size': 1}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102136900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f9deb5-8723-4031-8d12-4306f51dcdd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff6ced655174a91b86f1918a81bcc11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:28Z,use_quota=True,user_id='bd70565f8e114aeda553d88de44f8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Creating volume a6f9deb5-8723-4031-8d12-4306f51dcdd7 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:28 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f5b51488-ba32-4fb7-b040-7b612edc69f6" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 1073741824
Sep 23 00:33:28 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-quobyte-f5b51488-ba32-4fb7-b040-7b612edc69f6" released by "delete_volume" :: held 0.885s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Created reservations ['426388fb-59e8-4693-bc58-3e4affc23eb4', '25f020a7-b6e5-4f05-bfcf-aa785e755f46', '8e62b35a-64e6-4511-ab30-4ce9599960f9', '3a9a213d-9978-45dc-8522-402472ae0cd1'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:28 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:28 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 1073741824" returned: 0 in 0.474s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:28 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.284s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Deleted volume successfully.
Sep 23 00:33:28 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7
Sep 23 00:33:28 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b19676f9-435c-4c46-a25d-40939d3bb8dd tempest-SnapshotDependencyTests-2114187408 None] Lock "cinder-f5b51488-ba32-4fb7-b040-7b612edc69f6-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:28 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7" returned: 0 in 0.268s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4559c2c-5781-44aa-b9e0-c843e01d3b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3e76ea-7b94-453e-b897-a7f8e06622e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:28 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Volume volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 (a6f9deb5-8723-4031-8d12-4306f51dcdd7): created successfully
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3e76ea-7b94-453e-b897-a7f8e06622e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:28 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Flow 'volume_create_manager' (99446b7d-7481-47c3-bf60-2d0ebba1d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5485488f-3573-48fe-89a2-a1a6b1dcc180 tempest-ProjectReaderTests-732852733 None] Created volume successfully.
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Acquiring lock "cinder-a6f9deb5-8723-4031-8d12-4306f51dcdd7-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "cinder-a6f9deb5-8723-4031-8d12-4306f51dcdd7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Acquiring lock "cinder-quobyte-a6f9deb5-8723-4031-8d12-4306f51dcdd7" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "cinder-quobyte-a6f9deb5-8723-4031-8d12-4306f51dcdd7" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[805983b5-8e7b-4a6d-b73c-3b5096a2c390]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:30 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7
Sep 23 00:33:30 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:30 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7" returned: 0 in 0.402s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:30 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7
Sep 23 00:33:30 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:30 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a6f9deb5-8723-4031-8d12-4306f51dcdd7" returned: 0 in 0.273s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "cinder-quobyte-a6f9deb5-8723-4031-8d12-4306f51dcdd7" released by "delete_volume" :: held 0.730s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Created reservations ['15d5543f-9593-40a2-983b-5a9258b82e4d', '41455457-3fbe-4cd0-a273-ed058c6449b0', 'fe275f5c-ed89-415a-ad65-e8d521680848', '855f3251-eb34-4fe8-a688-5f99f84d2d31'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:31 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:31 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:31 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.329s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Deleted volume successfully.
Sep 23 00:33:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-363f8de5-cb64-434a-a69e-02c97a09e118 tempest-ProjectReaderTests-732852733 None] Lock "cinder-a6f9deb5-8723-4031-8d12-4306f51dcdd7-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (87dcd295-56e5-4cd8-95c7-314dae13e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22c72db-91d5-44ce-b0e2-b878241e60f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22c72db-91d5-44ce-b0e2-b878241e60f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221617439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17172ccf-6c6d-4b11-8518-e8f5170c27f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3bb54-e726-4977-9e32-2eb2b6d81250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3bb54-e726-4977-9e32-2eb2b6d81250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed20c0-f68a-495d-956d-a3a13d46d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed20c0-f68a-495d-956d-a3a13d46d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17172ccf-6c6d-4b11-8518-e8f5170c27f6', 'volume_name': 'volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337ea4d-f7d1-455a-b09c-c25cabcbd7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337ea4d-f7d1-455a-b09c-c25cabcbd7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff27d9da-9ad2-468e-8e60-af2ce150fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Volume 17172ccf-6c6d-4b11-8518-e8f5170c27f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6', 'volume_size': 1}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221617439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17172ccf-6c6d-4b11-8518-e8f5170c27f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Creating volume 17172ccf-6c6d-4b11-8518-e8f5170c27f6 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:36 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:36 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 1073741824
Sep 23 00:33:36 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:37 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 1073741824" returned: 0 in 0.531s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:37 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6
Sep 23 00:33:37 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:37 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff27d9da-9ad2-468e-8e60-af2ce150fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18156c73-81cc-4b90-b438-696b6209a31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Volume volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 (17172ccf-6c6d-4b11-8518-e8f5170c27f6): created successfully
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18156c73-81cc-4b90-b438-696b6209a31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (87dcd295-56e5-4cd8-95c7-314dae13e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d6b413e9-f2b5-46f8-8ae9-5081340d5aa3 tempest-ProjectReaderTests-1978417395 None] Created volume successfully.
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-17172ccf-6c6d-4b11-8518-e8f5170c27f6-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-17172ccf-6c6d-4b11-8518-e8f5170c27f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-quobyte-17172ccf-6c6d-4b11-8518-e8f5170c27f6" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-17172ccf-6c6d-4b11-8518-e8f5170c27f6" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae4a991-4f16-4c91-95ad-a5b78a968e6a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:38 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6
Sep 23 00:33:38 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:39 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6" returned: 0 in 0.475s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:39 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6
Sep 23 00:33:39 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:39 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-17172ccf-6c6d-4b11-8518-e8f5170c27f6" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-17172ccf-6c6d-4b11-8518-e8f5170c27f6" released by "delete_volume" :: held 0.838s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Created reservations ['044c8af5-26e3-405e-ba13-a6dc5cf16fd0', '342a1efe-1d85-4c21-bf53-b30cee1cdaac', '0ec21190-b924-492d-a90a-7d6934850da8', '3626997f-361d-45a5-b226-4501f0be6b3d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:39 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:39 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:40 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.384s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Deleted volume successfully.
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e330bf6-b44f-43fd-9f19-6d05c87b4e32 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-17172ccf-6c6d-4b11-8518-e8f5170c27f6-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (56e0a4df-d0fd-4314-a6a2-f4c73ae6d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09057f-97d1-41b6-be5f-487a0b78864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09057f-97d1-41b6-be5f-487a0b78864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878965950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb02a9-405e-486c-9e23-5d8fe26e04a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:40Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac539083-c566-4ed5-8ae8-e5a912d268a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac539083-c566-4ed5-8ae8-e5a912d268a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60394a00-2286-4ea1-b3d5-74eadf3d7fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60394a00-2286-4ea1-b3d5-74eadf3d7fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fb02a9-405e-486c-9e23-5d8fe26e04a1', 'volume_name': 'volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7010be50-158c-4fbc-a888-6dd564e4b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7010be50-158c-4fbc-a888-6dd564e4b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab1f51-74b1-41aa-8c7b-b4461426b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Volume 80fb02a9-405e-486c-9e23-5d8fe26e04a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1', 'volume_size': 1}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878965950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb02a9-405e-486c-9e23-5d8fe26e04a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:40Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Creating volume 80fb02a9-405e-486c-9e23-5d8fe26e04a1 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:40 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:40 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 1073741824
Sep 23 00:33:40 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:41 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 1073741824" returned: 0 in 0.510s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:41 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1
Sep 23 00:33:41 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:41 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1" returned: 0 in 0.300s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab1f51-74b1-41aa-8c7b-b4461426b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39dc938-845e-4dc2-8b71-8f31fe646887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Volume volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 (80fb02a9-405e-486c-9e23-5d8fe26e04a1): created successfully
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39dc938-845e-4dc2-8b71-8f31fe646887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (56e0a4df-d0fd-4314-a6a2-f4c73ae6d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c9d52b44-b576-4183-b109-2854534edf3a tempest-ProjectReaderTests-1978417395 None] Created volume successfully.
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-80fb02a9-405e-486c-9e23-5d8fe26e04a1-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-80fb02a9-405e-486c-9e23-5d8fe26e04a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-quobyte-80fb02a9-405e-486c-9e23-5d8fe26e04a1" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-80fb02a9-405e-486c-9e23-5d8fe26e04a1" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52155b3-361f-403d-b3ab-7ef687e915ec]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:42 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1
Sep 23 00:33:42 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:43 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1" returned: 0 in 0.390s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:43 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1
Sep 23 00:33:43 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:43 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-80fb02a9-405e-486c-9e23-5d8fe26e04a1" returned: 0 in 0.254s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-80fb02a9-405e-486c-9e23-5d8fe26e04a1" released by "delete_volume" :: held 0.692s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Created reservations ['0cb82808-fbf3-47c3-b443-134292c54ae0', 'b595cd79-4a9f-4bcc-8d11-1bb112e4ac40', '994cc75e-513e-4503-9389-f907877ffc74', '9d037609-e5c8-4e2e-80c6-290d9aba3a83'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:43 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:43 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:43 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.283s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Deleted volume successfully.
Sep 23 00:33:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ea92c020-2d1a-45a0-86ca-97b7f4c08bb3 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-80fb02a9-405e-486c-9e23-5d8fe26e04a1-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (2d6c4dba-1945-4cbb-b7fc-f325ab0881eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08850ed7-c4bd-4c28-a24c-b0ddc77fc6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08850ed7-c4bd-4c28-a24c-b0ddc77fc6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160402086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f6e609-13e9-479f-a0a9-6a72186c39bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:44Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f1fb9e-1713-49d0-89c8-4be8a88e31fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f1fb9e-1713-49d0-89c8-4be8a88e31fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db76e075-af3f-467c-8f3b-e64d140c92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db76e075-af3f-467c-8f3b-e64d140c92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f6e609-13e9-479f-a0a9-6a72186c39bf', 'volume_name': 'volume-82f6e609-13e9-479f-a0a9-6a72186c39bf', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6803d585-197a-4096-9df0-49f3976c31ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6803d585-197a-4096-9df0-49f3976c31ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5db07bc-d62f-449d-b400-6a336374607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Volume 82f6e609-13e9-479f-a0a9-6a72186c39bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f6e609-13e9-479f-a0a9-6a72186c39bf', 'volume_size': 1}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160402086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f6e609-13e9-479f-a0a9-6a72186c39bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:44Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Creating volume 82f6e609-13e9-479f-a0a9-6a72186c39bf {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:44 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf 1073741824
Sep 23 00:33:44 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:44 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf 1073741824" returned: 0 in 0.468s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:44 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf
Sep 23 00:33:44 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:45 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf" returned: 0 in 0.285s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5db07bc-d62f-449d-b400-6a336374607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f6e609-13e9-479f-a0a9-6a72186c39bf', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63676a04-2135-41b8-b26f-31344e2a2f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Volume volume-82f6e609-13e9-479f-a0a9-6a72186c39bf (82f6e609-13e9-479f-a0a9-6a72186c39bf): created successfully
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63676a04-2135-41b8-b26f-31344e2a2f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (2d6c4dba-1945-4cbb-b7fc-f325ab0881eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4e0c2455-3544-4333-9591-5be88fed0c59 tempest-ProjectReaderTests-1978417395 None] Created volume successfully.
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-82f6e609-13e9-479f-a0a9-6a72186c39bf-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-82f6e609-13e9-479f-a0a9-6a72186c39bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-quobyte-82f6e609-13e9-479f-a0a9-6a72186c39bf" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-82f6e609-13e9-479f-a0a9-6a72186c39bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d92e27-5ed5-4eca-ad9a-34568d44ef8a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:46 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf
Sep 23 00:33:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:47 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf" returned: 0 in 0.451s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:47 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf
Sep 23 00:33:47 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:47 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-82f6e609-13e9-479f-a0a9-6a72186c39bf" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-82f6e609-13e9-479f-a0a9-6a72186c39bf" released by "delete_volume" :: held 0.848s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Created reservations ['701d5498-f523-4288-a97d-bb2fcbc1f7f2', '52000785-e2b2-4518-86e5-1b6df8fc6310', 'cb0b2797-edfd-4d78-97eb-3c5ca1c10fcb', 'a4b594c4-97e6-4b44-8549-2b33ab572dc9'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:47 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:47 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:47 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.346s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:47 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Deleted volume successfully.
Sep 23 00:33:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-64d8c38e-b0f1-4e81-94b2-00539ce3ce29 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-82f6e609-13e9-479f-a0a9-6a72186c39bf-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (7ab20d7e-b98e-4dc6-98b7-9b5910b2e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c52f5-c6dc-4cf0-b163-17081905e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c52f5-c6dc-4cf0-b163-17081905e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062895765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d40f527-0188-4393-ba08-ccf69f6b4925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:48Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52ab26-451b-40cd-9e5d-8da9a3904d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52ab26-451b-40cd-9e5d-8da9a3904d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206222c2-2b24-4347-901c-1e1fe7a06fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206222c2-2b24-4347-901c-1e1fe7a06fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d40f527-0188-4393-ba08-ccf69f6b4925', 'volume_name': 'volume-3d40f527-0188-4393-ba08-ccf69f6b4925', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59254fc-7f32-442e-a9ee-d1895ee907f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59254fc-7f32-442e-a9ee-d1895ee907f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7afac14-1dab-427a-b870-1ba4e730360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:48 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Volume 3d40f527-0188-4393-ba08-ccf69f6b4925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d40f527-0188-4393-ba08-ccf69f6b4925', 'volume_size': 1}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062895765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d40f527-0188-4393-ba08-ccf69f6b4925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b00614e2d44463a248c12f86921000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:48Z,use_quota=True,user_id='8a9fcc53374c4d8d8215ce047dfbab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Creating volume 3d40f527-0188-4393-ba08-ccf69f6b4925 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:33:48 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:48 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 1073741824
Sep 23 00:33:48 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:48 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 1073741824" returned: 0 in 0.505s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:48 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925
Sep 23 00:33:48 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:49 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925" returned: 0 in 0.328s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7afac14-1dab-427a-b870-1ba4e730360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d40f527-0188-4393-ba08-ccf69f6b4925', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a59897-86cf-4029-946e-dda98618e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:33:49 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Volume volume-3d40f527-0188-4393-ba08-ccf69f6b4925 (3d40f527-0188-4393-ba08-ccf69f6b4925): created successfully
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a59897-86cf-4029-946e-dda98618e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:33:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Flow 'volume_create_manager' (7ab20d7e-b98e-4dc6-98b7-9b5910b2e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:33:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2492e72c-2423-4bde-b8a2-703d3b118b89 tempest-ProjectReaderTests-1978417395 None] Created volume successfully.
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-3d40f527-0188-4393-ba08-ccf69f6b4925-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-3d40f527-0188-4393-ba08-ccf69f6b4925-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "cinder-quobyte-3d40f527-0188-4393-ba08-ccf69f6b4925" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-3d40f527-0188-4393-ba08-ccf69f6b4925" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b84eab-34ec-459d-84cf-76be668c3fb5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:33:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:50 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925
Sep 23 00:33:50 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:51 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925" returned: 0 in 0.425s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:51 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925
Sep 23 00:33:51 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:51 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d40f527-0188-4393-ba08-ccf69f6b4925" returned: 0 in 0.262s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-quobyte-3d40f527-0188-4393-ba08-ccf69f6b4925" released by "delete_volume" :: held 0.741s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Created reservations ['c13653eb-e630-4224-8d32-8a91a101618a', 'd954dd43-f266-413f-a4b5-91a77020bf7f', 'c3f73bb9-bf7f-4743-8740-32b9a61d36c7', '3989b79b-f7ff-4c4f-928a-938946e2daa3'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:51 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:51 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:51 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:51 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Deleted volume successfully.
Sep 23 00:33:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0332e872-9f48-4871-8efc-2f0626175c12 tempest-ProjectReaderTests-1978417395 None] Lock "cinder-3d40f527-0188-4393-ba08-ccf69f6b4925-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:33:57 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:33:57 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:33:57 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.298s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:33:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:34:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=123,cinder:DELETE=14,cinder:SELECT=89,cinder:INSERT=23 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:34:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=88,cinder:INSERT=37,cinder:UPDATE=124,cinder:DELETE=8 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Flow 'volume_create_manager' (36d86d59-851a-40f0-ac73-b70111de636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f3a4c1-a6c2-49b2-9a16-177b63a3575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f3a4c1-a6c2-49b2-9a16-177b63a3575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9770ffd1-2ea3-4fc6-afd1-e8616497f380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229a86a237442b39e749cc0430b6b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='3dd53719592e4dd289f84d81ba489226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e13aa-8c92-47d8-b090-81ab265381bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e13aa-8c92-47d8-b090-81ab265381bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d7e7d9-0d19-47d9-b262-e702ff67d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d7e7d9-0d19-47d9-b262-e702ff67d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9770ffd1-2ea3-4fc6-afd1-e8616497f380', 'volume_name': 'volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dab2d65-15ff-4cc7-859b-924a57d4b5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dab2d65-15ff-4cc7-859b-924a57d4b5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc41b-f75e-4ecf-8de6-2f71c9026fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Volume 9770ffd1-2ea3-4fc6-afd1-e8616497f380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380', 'volume_size': 1}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9770ffd1-2ea3-4fc6-afd1-e8616497f380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229a86a237442b39e749cc0430b6b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='3dd53719592e4dd289f84d81ba489226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Creating volume 9770ffd1-2ea3-4fc6-afd1-e8616497f380 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:06 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 1073741824
Sep 23 00:34:06 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (23af9256-d642-49eb-a022-e7fcdfbec257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f134e-3d74-449b-a016-bad602f95d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f134e-3d74-449b-a016-bad602f95d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712897803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb41bc1-68dd-44cf-80bc-1602a06cc886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125609c-703b-4490-8062-092de0d32cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7125609c-703b-4490-8062-092de0d32cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9abf4c-fc49-444e-a78c-58a93788f8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9abf4c-fc49-444e-a78c-58a93788f8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb41bc1-68dd-44cf-80bc-1602a06cc886', 'volume_name': 'volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3780b-572e-4067-aa83-86013654e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3780b-572e-4067-aa83-86013654e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3bbfb-0681-49a4-8110-5e192beb5157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 3bb41bc1-68dd-44cf-80bc-1602a06cc886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886', 'volume_size': 1}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:06 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 1073741824" returned: 0 in 0.647s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:07 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380
Sep 23 00:34:07 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (86dd7173-d0a3-4d7c-a038-1ee92c0c003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537bc298-3777-4384-86b2-cadabcdc040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537bc298-3777-4384-86b2-cadabcdc040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598164128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15149dd2-f713-4087-9681-518e6b03287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:07Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34ed2bf-8e93-464f-b5fc-696f17c899c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34ed2bf-8e93-464f-b5fc-696f17c899c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fad97c-482e-4443-b606-8833e2c0da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fad97c-482e-4443-b606-8833e2c0da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15149dd2-f713-4087-9681-518e6b03287d', 'volume_name': 'volume-15149dd2-f713-4087-9681-518e6b03287d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d627c0c-28c6-46bb-afa2-7426ae9f4ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d627c0c-28c6-46bb-afa2-7426ae9f4ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c6bdc1-46e2-4f12-8c57-0cffcb6e6845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Volume 15149dd2-f713-4087-9681-518e6b03287d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15149dd2-f713-4087-9681-518e6b03287d', 'volume_size': 1}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:07 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380" returned: 0 in 0.369s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712897803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb41bc1-68dd-44cf-80bc-1602a06cc886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 3bb41bc1-68dd-44cf-80bc-1602a06cc886 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:07 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc41b-f75e-4ecf-8de6-2f71c9026fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 1073741824
Sep 23 00:34:07 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f901426-9bd9-4664-ba94-ba7fead0127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Volume volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 (9770ffd1-2ea3-4fc6-afd1-e8616497f380): created successfully
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f901426-9bd9-4664-ba94-ba7fead0127f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Flow 'volume_create_manager' (36d86d59-851a-40f0-ac73-b70111de636c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2951866c-221d-410b-b99b-e18be7962ee8 tempest-CinderUnicodeTest-1025507525 None] Created volume successfully.
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (2b0da349-b32b-406f-9965-bb824104a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689105fc-be59-44a4-995d-9bc32e645f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689105fc-be59-44a4-995d-9bc32e645f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424248346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6102709c-d56d-4b63-afdf-253324310af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5d4f7b-365a-4131-b6aa-a5531e80a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5d4f7b-365a-4131-b6aa-a5531e80a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e4dd57-161c-471a-80b8-83f1e1058d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e4dd57-161c-471a-80b8-83f1e1058d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6102709c-d56d-4b63-afdf-253324310af0', 'volume_name': 'volume-6102709c-d56d-4b63-afdf-253324310af0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116cbf94-3ba3-498b-b061-51ab0e5f206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116cbf94-3ba3-498b-b061-51ab0e5f206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a652c7ff-3580-4ea4-86fd-ca26737e15a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Volume 6102709c-d56d-4b63-afdf-253324310af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6102709c-d56d-4b63-afdf-253324310af0', 'volume_size': 1}
Sep 23 00:34:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:08 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 1073741824" returned: 0 in 0.691s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (a3640d16-290a-4675-b1c1-52ad96bb3f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66265ad7-3684-4681-949b-36535f43329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66265ad7-3684-4681-949b-36535f43329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297780975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fdeb0d-4d0a-42f1-ba37-e2907552baef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690d8a7f-8fd9-432c-aed7-26310040eb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690d8a7f-8fd9-432c-aed7-26310040eb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b9dcb7-dcc1-4f71-9238-69d9228680c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b9dcb7-dcc1-4f71-9238-69d9228680c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fdeb0d-4d0a-42f1-ba37-e2907552baef', 'volume_name': 'volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0de8f43-a6b5-4417-b586-86c0a9ab3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0de8f43-a6b5-4417-b586-86c0a9ab3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f8e188-f9f2-4449-8480-3b294fb04af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Volume c8fdeb0d-4d0a-42f1-ba37-e2907552baef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef', 'volume_size': 1}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:08 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886
Sep 23 00:34:08 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:08 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886" returned: 0 in 0.390s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598164128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15149dd2-f713-4087-9681-518e6b03287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:07Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Creating volume 15149dd2-f713-4087-9681-518e6b03287d {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:08 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:08 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d 1073741824
Sep 23 00:34:08 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (30033aa0-e688-4a47-a678-be8cd98ea20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91214d9d-27e4-4410-a75b-ef8496502c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3bbfb-0681-49a4-8110-5e192beb5157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bcc595-43c7-43b0-a2ba-eace08c0ddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91214d9d-27e4-4410-a75b-ef8496502c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208384949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce156a8-d90b-412b-bebf-3deb4abefb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:09Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a11d7cc-90cc-4f9a-9bad-09b9ad896261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a11d7cc-90cc-4f9a-9bad-09b9ad896261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642e45d7-1591-4fc8-904e-0ab22147b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642e45d7-1591-4fc8-904e-0ab22147b84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce156a8-d90b-412b-bebf-3deb4abefb11', 'volume_name': 'volume-4ce156a8-d90b-412b-bebf-3deb4abefb11', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145a0a09-7a01-40e9-9f67-61bdaef712b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145a0a09-7a01-40e9-9f67-61bdaef712b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8addf936-e0fe-4212-9a9f-1f18839cafbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Volume 4ce156a8-d90b-412b-bebf-3deb4abefb11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce156a8-d90b-412b-bebf-3deb4abefb11', 'volume_size': 1}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:08 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 (3bb41bc1-68dd-44cf-80bc-1602a06cc886): created successfully
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bcc595-43c7-43b0-a2ba-eace08c0ddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:08 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (23af9256-d642-49eb-a022-e7fcdfbec257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7b791509-f4d3-4139-9426-a19f2834fee0 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (2be085d1-7478-43e6-bfdd-0a000bec1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81dc40e-d385-4e98-b495-4c1f7432c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81dc40e-d385-4e98-b495-4c1f7432c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605681321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62fa1f2-2d73-4487-b425-803b09c2bd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:09Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b649ef9-2757-4c05-af1a-12ce742b795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b649ef9-2757-4c05-af1a-12ce742b795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf9bd49-c803-410d-95cc-7312f7e483dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf9bd49-c803-410d-95cc-7312f7e483dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62fa1f2-2d73-4487-b425-803b09c2bd43', 'volume_name': 'volume-a62fa1f2-2d73-4487-b425-803b09c2bd43', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1a0353-ac3a-4462-b378-d7513059c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1a0353-ac3a-4462-b378-d7513059c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9382397d-34e4-4b4e-bf14-9d2386b823f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Volume a62fa1f2-2d73-4487-b425-803b09c2bd43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62fa1f2-2d73-4487-b425-803b09c2bd43', 'volume_size': 1}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:09 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d 1073741824" returned: 0 in 0.755s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:09 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d
Sep 23 00:34:09 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Flow 'volume_create_manager' (6f60826b-4f9a-4a27-811b-2c48ec23f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5dc0cb-7b4b-430a-aa04-e1016ec58349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5dc0cb-7b4b-430a-aa04-e1016ec58349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-205750154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d3e2dd-fa8d-484d-879b-1ad0667d189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229a86a237442b39e749cc0430b6b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='3dd53719592e4dd289f84d81ba489226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21d42be-fef3-4ff8-aa68-e88605b71c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21d42be-fef3-4ff8-aa68-e88605b71c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629bc12-bd8c-441c-9c04-d2c7a7e1547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629bc12-bd8c-441c-9c04-d2c7a7e1547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d3e2dd-fa8d-484d-879b-1ad0667d189a', 'volume_name': 'volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449733d-c9d4-4d0e-9be4-bce1510b9399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449733d-c9d4-4d0e-9be4-bce1510b9399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e09956-e953-4244-9cb5-0f8d805299b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Volume f6d3e2dd-fa8d-484d-879b-1ad0667d189a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a', 'volume_size': 1}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:09 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d" returned: 0 in 0.290s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424248346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6102709c-d56d-4b63-afdf-253324310af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Creating volume 6102709c-d56d-4b63-afdf-253324310af0 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:09 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c6bdc1-46e2-4f12-8c57-0cffcb6e6845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15149dd2-f713-4087-9681-518e6b03287d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 1073741824
Sep 23 00:34:09 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffc71f6-0186-441f-acbc-6d2a39155f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:09 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Volume volume-15149dd2-f713-4087-9681-518e6b03287d (15149dd2-f713-4087-9681-518e6b03287d): created successfully
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffc71f6-0186-441f-acbc-6d2a39155f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:09 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (86dd7173-d0a3-4d7c-a038-1ee92c0c003b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5769eb89-dbf0-42b5-840a-53bea06b2532 tempest-CreateVolumesFromImageTest-1334806364 None] Created volume successfully.
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (51d2092c-4f73-4f44-b815-ea8e41e15cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d161b-cd16-4f93-a132-ddfac169e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d161b-cd16-4f93-a132-ddfac169e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232834758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d85ddf8-5b0f-4715-8168-59f331517573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a111148d-2f75-45a5-9052-0c3f7449dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a111148d-2f75-45a5-9052-0c3f7449dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c859b4-24d2-40e1-b6d1-f07c678dfecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c859b4-24d2-40e1-b6d1-f07c678dfecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d85ddf8-5b0f-4715-8168-59f331517573', 'volume_name': 'volume-3d85ddf8-5b0f-4715-8168-59f331517573', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e33d1cd-1b4e-4d1d-8f47-abeab02b40b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e33d1cd-1b4e-4d1d-8f47-abeab02b40b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322619a6-3cf9-4389-b8f3-d5bc02516674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 3d85ddf8-5b0f-4715-8168-59f331517573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d85ddf8-5b0f-4715-8168-59f331517573', 'volume_size': 1}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 1073741824" returned: 0 in 0.733s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:10 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0
Sep 23 00:34:10 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (e6ddeef8-07e7-4794-a909-6cc61a0f5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cd328c-468e-4bc2-9a89-9e6f5a3f50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cd328c-468e-4bc2-9a89-9e6f5a3f50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925411029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:11Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16658ff1-f171-4568-b8d5-d47ea02a8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16658ff1-f171-4568-b8d5-d47ea02a8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12cf455-2407-4b2c-b9e8-fcb018055737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12cf455-2407-4b2c-b9e8-fcb018055737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c', 'volume_name': 'volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3253a60a-af5d-40a9-88ac-9707e4db4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3253a60a-af5d-40a9-88ac-9707e4db4301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd10b4-0b57-46c8-89e7-ddb652bd79ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c', 'volume_size': 1}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0" returned: 0 in 0.492s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.813s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297780975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fdeb0d-4d0a-42f1-ba37-e2907552baef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Creating volume c8fdeb0d-4d0a-42f1-ba37-e2907552baef {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:11 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:11 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef 1073741824
Sep 23 00:34:11 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a652c7ff-3580-4ea4-86fd-ca26737e15a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6102709c-d56d-4b63-afdf-253324310af0', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2a68ca-02e1-48be-8299-7f11d6d8a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Volume volume-6102709c-d56d-4b63-afdf-253324310af0 (6102709c-d56d-4b63-afdf-253324310af0): created successfully
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2a68ca-02e1-48be-8299-7f11d6d8a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (2b0da349-b32b-406f-9965-bb824104a33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:11 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1ccc88f8-8379-402d-96f0-6ad2f08a9cf5 tempest-CreateVolumesFromImageTest-1334806364 None] Created volume successfully.
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (6120a796-11c9-4f74-82c1-22adccdaaf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c08861b-404a-49fa-afe0-0ca193843769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c08861b-404a-49fa-afe0-0ca193843769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1711183881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66b4d3-a055-4633-a4c1-aac06a34aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66b4d3-a055-4633-a4c1-aac06a34aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47800835-de37-4bf5-9d10-be305d842534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47800835-de37-4bf5-9d10-be305d842534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b', 'volume_name': 'volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaec7e0f-234e-4db6-8fc5-640e5ceaf5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaec7e0f-234e-4db6-8fc5-640e5ceaf5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36e8e3b-ca18-4bfa-89aa-ca4795e9e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:11 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b', 'volume_size': 1}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef 1073741824" returned: 0 in 0.861s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:12 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef
Sep 23 00:34:12 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Flow 'volume_create_manager' (cc72ecbf-8bf3-4999-bae3-1ae5a1601c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddad9ab0-a14a-4843-a747-f5b027f9890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddad9ab0-a14a-4843-a747-f5b027f9890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2730e83-94e6-47c1-877f-cfbaec6fe171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0088427ddc34221a235a9aa30d82c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='675bb21f6aaf4cd4a92ba28bbf3391ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ac6fda4-87d5-488e-a33c-83fd550da7ff),volume_type_id=5ac6fda4-87d5-488e-a33c-83fd550da7ff)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd7e5aa-65ce-4b75-b1ba-8a70857f42e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd7e5aa-65ce-4b75-b1ba-8a70857f42e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06145f99-53b3-4b2b-bb92-f83cc520c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (d576187d-1e7d-4abe-ae34-6b7c684c0244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55bc872-515a-4d5b-a818-99c3f9e09064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55bc872-515a-4d5b-a818-99c3f9e09064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1173161314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89748cd6-5045-4a5b-bfc4-d719a5e8f8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9773fb69-b32c-45b7-98c5-442b3862df9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9773fb69-b32c-45b7-98c5-442b3862df9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb93c64e-ccc9-4d70-8381-fd837999f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb93c64e-ccc9-4d70-8381-fd837999f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89748cd6-5045-4a5b-bfc4-d719a5e8f8cd', 'volume_name': 'volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9b9ab8-26f8-40e5-99cb-a2a58b9c47a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9b9ab8-26f8-40e5-99cb-a2a58b9c47a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10d63f1-b8de-4fe8-b0d1-5ef053f308fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 89748cd6-5045-4a5b-bfc4-d719a5e8f8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd', 'volume_size': 1}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" returned: 0 in 0.498s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.583s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208384949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce156a8-d90b-412b-bebf-3deb4abefb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:09Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Creating volume 4ce156a8-d90b-412b-bebf-3deb4abefb11 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:12 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 1073741824
Sep 23 00:34:12 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f8e188-f9f2-4449-8480-3b294fb04af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc1917-ee17-4b65-8216-cefc61b548e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Volume volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef (c8fdeb0d-4d0a-42f1-ba37-e2907552baef): created successfully
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc1917-ee17-4b65-8216-cefc61b548e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (a3640d16-290a-4675-b1c1-52ad96bb3f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-53becaa2-8a7e-469b-aca9-2d940cb6d4c2 tempest-CreateVolumesFromImageTest-1334806364 None] Created volume successfully.
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (11ec2717-fd32-4b26-b336-6a5e3d35d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19943938-7ddb-4b9c-862e-56527b9624f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19943938-7ddb-4b9c-862e-56527b9624f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762791437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a7f219-ca36-4a43-a13c-7bef38ec0830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c291705-3031-4461-a4dc-01fbc8438205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c291705-3031-4461-a4dc-01fbc8438205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8537977-1604-4b1e-97f0-5c4bcff89e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8537977-1604-4b1e-97f0-5c4bcff89e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a7f219-ca36-4a43-a13c-7bef38ec0830', 'volume_name': 'volume-96a7f219-ca36-4a43-a13c-7bef38ec0830', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82c318f-2682-40d0-8e72-9c4790130c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82c318f-2682-40d0-8e72-9c4790130c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb25a69-71bc-489f-87aa-1ccfad999005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume 96a7f219-ca36-4a43-a13c-7bef38ec0830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a7f219-ca36-4a43-a13c-7bef38ec0830', 'volume_size': 1}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06145f99-53b3-4b2b-bb92-f83cc520c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2730e83-94e6-47c1-877f-cfbaec6fe171', 'volume_name': 'volume-d2730e83-94e6-47c1-877f-cfbaec6fe171', 'volume_size': 1, 'image_id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea62ba205f68276393bf188ba2792211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0088427ddc34221a235a9aa30d82c67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3553253ab26230174ab314f4e6587993fcb7b6ee41b3282bc1ecefd84d032b476b4a0dea9c28d171255ad17b8c82f0460e606f1f81a6e4670ea3f8ac4b4cfa59', 'id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f461d0d0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139f25d4-68f9-4761-971e-33ecef9fc10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139f25d4-68f9-4761-971e-33ecef9fc10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fda97f-73ad-4001-9676-31f2541af887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:12 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Volume d2730e83-94e6-47c1-877f-cfbaec6fe171: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2730e83-94e6-47c1-877f-cfbaec6fe171', 'volume_size': 1, 'image_id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea62ba205f68276393bf188ba2792211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0088427ddc34221a235a9aa30d82c67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3553253ab26230174ab314f4e6587993fcb7b6ee41b3282bc1ecefd84d032b476b4a0dea9c28d171255ad17b8c82f0460e606f1f81a6e4670ea3f8ac4b4cfa59', 'id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f461d0d0>}
Sep 23 00:34:12 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Trying to clone d2730e83-94e6-47c1-877f-cfbaec6fe171 from image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:34:13 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69470c1-2567-4dae-a5a4-4c92f30c5326]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 1073741824" returned: 0 in 0.759s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:13 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:13 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11
Sep 23 00:34:13 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11" returned: 0 in 0.308s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.236s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605681321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62fa1f2-2d73-4487-b425-803b09c2bd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239e6700ff344dc0a7927fe5da0d8389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:09Z,use_quota=True,user_id='7cbd3227a3494ad4bf864e8761c8f58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Creating volume a62fa1f2-2d73-4487-b425-803b09c2bd43 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:13 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:13 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:13 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8addf936-e0fe-4212-9a9f-1f18839cafbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce156a8-d90b-412b-bebf-3deb4abefb11', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 1073741824
Sep 23 00:34:13 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a51f96-90fe-49cf-b33a-f57894587425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:13 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Volume volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 (4ce156a8-d90b-412b-bebf-3deb4abefb11): created successfully
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a51f96-90fe-49cf-b33a-f57894587425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:13 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (30033aa0-e688-4a47-a678-be8cd98ea20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-392b09e5-c104-493c-b43d-067c1945388b tempest-CreateVolumesFromImageTest-1334806364 None] Created volume successfully.
Sep 23 00:34:14 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Temporary image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a is fetched for user 675bb21f6aaf4cd4a92ba28bbf3391ad. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27488d8-5f08-4344-8c37-4167c2746d62]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:14 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 1073741824" returned: 0 in 0.589s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43
Sep 23 00:34:14 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43" returned: 0 in 0.313s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-205750154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d3e2dd-fa8d-484d-879b-1ad0667d189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1229a86a237442b39e749cc0430b6b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='3dd53719592e4dd289f84d81ba489226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Creating volume f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:14 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:14 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:14 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9382397d-34e4-4b4e-bf14-9d2386b823f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62fa1f2-2d73-4487-b425-803b09c2bd43', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a 1073741824
Sep 23 00:34:14 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ba1d52-836c-4d97-bc5b-ed5d4b98dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:14 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Volume volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 (a62fa1f2-2d73-4487-b425-803b09c2bd43): created successfully
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ba1d52-836c-4d97-bc5b-ed5d4b98dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Flow 'volume_create_manager' (2be085d1-7478-43e6-bfdd-0a000bec1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:14 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8461afb7-9867-44f6-b8c0-209c2d212db9 tempest-CreateVolumesFromImageTest-1334806364 None] Created volume successfully.
Sep 23 00:34:14 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:15 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a 1073741824" returned: 0 in 0.621s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-a62fa1f2-2d73-4487-b425-803b09c2bd43-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-a62fa1f2-2d73-4487-b425-803b09c2bd43-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:15 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a
Sep 23 00:34:15 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-quobyte-a62fa1f2-2d73-4487-b425-803b09c2bd43" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-a62fa1f2-2d73-4487-b425-803b09c2bd43" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b9641-edc8-4b69-b979-4f68c00b72e6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43
Sep 23 00:34:15 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:15 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.118s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232834758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d85ddf8-5b0f-4715-8168-59f331517573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 3d85ddf8-5b0f-4715-8168-59f331517573 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:15 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 1073741824
Sep 23 00:34:15 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e09956-e953-4244-9cb5-0f8d805299b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6acc98a-7df4-47ac-8fd1-afc6f3f20bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:15 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Volume volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a (f6d3e2dd-fa8d-484d-879b-1ad0667d189a): created successfully
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6acc98a-7df4-47ac-8fd1-afc6f3f20bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Flow 'volume_create_manager' (6f60826b-4f9a-4a27-811b-2c48ec23f31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8e97bcaf-a2e3-4571-acb7-3f9a9df4d775 tempest-CinderUnicodeTest-1025507525 None] Created volume successfully.
Sep 23 00:34:15 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43" returned: 0 in 0.474s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:15 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43
Sep 23 00:34:15 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-a62fa1f2-2d73-4487-b425-803b09c2bd43" returned: 0 in 0.324s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-a62fa1f2-2d73-4487-b425-803b09c2bd43" released by "delete_volume" :: held 0.849s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Created reservations ['339ad3dd-8ad3-4ae7-bc0a-a17d45694163', 'e6a93e12-3849-4427-8acd-94c4ee587223', '9a580db1-094b-40db-ab64-38e75b642369', '180a390a-a837-49da-bc90-d0d8eb39312c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:16 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 1073741824" returned: 0 in 0.634s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573
Sep 23 00:34:16 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:16 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-4ce156a8-d90b-412b-bebf-3deb4abefb11-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-4ce156a8-d90b-412b-bebf-3deb4abefb11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-quobyte-4ce156a8-d90b-412b-bebf-3deb4abefb11" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-4ce156a8-d90b-412b-bebf-3deb4abefb11" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:16 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb501e5-d8d2-465c-981e-02905c62ab9b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573" returned: 0 in 0.310s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.631s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925411029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:11Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:16 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:16 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c 1073741824
Sep 23 00:34:16 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322619a6-3cf9-4389-b8f3-d5bc02516674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d85ddf8-5b0f-4715-8168-59f331517573', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c59444-df09-49b4-8fc3-dfaa7e2bfcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:16 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-3d85ddf8-5b0f-4715-8168-59f331517573 (3d85ddf8-5b0f-4715-8168-59f331517573): created successfully
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c59444-df09-49b4-8fc3-dfaa7e2bfcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (51d2092c-4f73-4f44-b815-ea8e41e15cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7270db6b-ab09-4a78-9f3d-49913838a9a4 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:16 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11
Sep 23 00:34:16 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:16 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Deleted volume successfully.
Sep 23 00:34:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-15c7ef32-2ec0-4993-870a-8ddac741136f tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-a62fa1f2-2d73-4487-b425-803b09c2bd43-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:17 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11" returned: 0 in 0.460s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11
Sep 23 00:34:17 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c 1073741824" returned: 0 in 0.650s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c
Sep 23 00:34:17 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4ce156a8-d90b-412b-bebf-3deb4abefb11" returned: 0 in 0.370s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-4ce156a8-d90b-412b-bebf-3deb4abefb11" released by "delete_volume" :: held 0.876s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Created reservations ['bfaae04f-afe2-46c6-afd9-74dc4ae6136f', '537684bc-5716-40d2-b371-0771aa67a805', 'f7a30e64-cd29-4e5c-8560-ac6622d4c6d5', 'fce9f550-aeee-4146-a1f7-3463def6b71c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:17 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" returned: 0 in 0.319s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.843s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1711183881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:17 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-c8fdeb0d-4d0a-42f1-ba37-e2907552baef-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:17 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b 1073741824
Sep 23 00:34:17 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd10b4-0b57-46c8-89e7-ddb652bd79ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6943289-b900-46c8-8ea0-458a6fd0b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-c8fdeb0d-4d0a-42f1-ba37-e2907552baef-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:17 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c (9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c): created successfully
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6943289-b900-46c8-8ea0-458a6fd0b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (e6ddeef8-07e7-4794-a909-6cc61a0f5be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e4cef70-5631-44f3-b9af-46b463469a9a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-quobyte-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[033526a8-ef8b-4719-9067-be23991c0de3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.361s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Deleted volume successfully.
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-77ca31f1-5313-4cbf-af84-3a0276e9b119 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-4ce156a8-d90b-412b-bebf-3deb4abefb11-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:18 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef
Sep 23 00:34:18 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b 1073741824" returned: 0 in 0.539s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b
Sep 23 00:34:18 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" returned: 0 in 0.436s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef
Sep 23 00:34:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" returned: 0 in 0.263s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.172s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1173161314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89748cd6-5045-4a5b-bfc4-d719a5e8f8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 89748cd6-5045-4a5b-bfc4-d719a5e8f8cd {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:18 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd 1073741824
Sep 23 00:34:18 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36e8e3b-ca18-4bfa-89aa-ca4795e9e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab4a91-8746-40ec-b84f-ac0151de801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:18 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b (90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b): created successfully
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab4a91-8746-40ec-b84f-ac0151de801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (6120a796-11c9-4f74-82c1-22adccdaaf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" returned: 0 in 0.289s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-261b44a5-2be6-46ac-b85d-5a4fc74be091 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-c8fdeb0d-4d0a-42f1-ba37-e2907552baef" released by "delete_volume" :: held 0.797s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Created reservations ['439bf9a6-9719-4079-8c88-147c05b862b1', '73836fa6-f576-4416-b419-980a1bf8efbd', 'ac1610d9-104e-40c0-b76d-0d236c3f2dcc', 'aa77efc9-375c-4f9e-9500-d5b021fa067d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:18 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:18 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-6102709c-d56d-4b63-afdf-253324310af0-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-6102709c-d56d-4b63-afdf-253324310af0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-quobyte-6102709c-d56d-4b63-afdf-253324310af0" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-6102709c-d56d-4b63-afdf-253324310af0" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd57879-8f5c-4674-a4cd-ffe5ae5a53e0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.301s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:19 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0
Sep 23 00:34:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Deleted volume successfully.
Sep 23 00:34:19 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd 1073741824" returned: 0 in 0.589s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d213b2f3-507d-40d8-b950-d0c1159a7400 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-c8fdeb0d-4d0a-42f1-ba37-e2907552baef-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd
Sep 23 00:34:19 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0" returned: 0 in 0.450s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" returned: 0 in 0.259s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.656s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762791437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a7f219-ca36-4a43-a13c-7bef38ec0830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef6bee16c8491d9207a818420925af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:13Z,use_quota=True,user_id='c2555640c2bf4676b04eb8e1a07ce617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Creating volume 96a7f219-ca36-4a43-a13c-7bef38ec0830 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:19 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0
Sep 23 00:34:19 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10d63f1-b8de-4fe8-b0d1-5ef053f308fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:19 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 1073741824
Sep 23 00:34:19 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb8e386-2fd8-4c7f-bd08-e80295eb018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd (89748cd6-5045-4a5b-bfc4-d719a5e8f8cd): created successfully
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb8e386-2fd8-4c7f-bd08-e80295eb018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (d576187d-1e7d-4abe-ae34-6b7c684c0244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2d747f80-369f-41b2-8189-0a4b5b1caf01 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:19 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6102709c-d56d-4b63-afdf-253324310af0" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-6102709c-d56d-4b63-afdf-253324310af0" released by "delete_volume" :: held 0.776s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Created reservations ['5b7c0d3a-412c-450f-bfba-22198f50729e', '14b97939-fb9e-43be-a103-f5fae5f9a004', '275fe4af-a60b-46db-ab84-dc14af838990', '1b342675-b517-4ffa-8e0a-9cda1fe60581'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:20 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 1073741824" returned: 0 in 0.512s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830
Sep 23 00:34:20 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-15149dd2-f713-4087-9681-518e6b03287d-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-15149dd2-f713-4087-9681-518e6b03287d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "cinder-quobyte-15149dd2-f713-4087-9681-518e6b03287d" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:20 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-15149dd2-f713-4087-9681-518e6b03287d" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Deleted volume successfully.
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5487e16a-3207-418d-baa0-185ec0c6e3dd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-88557957-f2cb-425a-b6b9-59f727085064 tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-6102709c-d56d-4b63-afdf-253324310af0-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:20 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830" returned: 0 in 0.366s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.556s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2730e83-94e6-47c1-877f-cfbaec6fe171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0088427ddc34221a235a9aa30d82c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:12Z,use_quota=True,user_id='675bb21f6aaf4cd4a92ba28bbf3391ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ac6fda4-87d5-488e-a33c-83fd550da7ff),volume_type_id=5ac6fda4-87d5-488e-a33c-83fd550da7ff)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Creating volume d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:20 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d
Sep 23 00:34:20 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1073741824
Sep 23 00:34:20 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb25a69-71bc-489f-87aa-1ccfad999005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a7f219-ca36-4a43-a13c-7bef38ec0830', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991b9cb4-e626-48dd-b611-f0374067a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Volume volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 (96a7f219-ca36-4a43-a13c-7bef38ec0830): created successfully
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991b9cb4-e626-48dd-b611-f0374067a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Flow 'volume_create_manager' (11ec2717-fd32-4b26-b336-6a5e3d35d273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-de249dcd-4ecb-4d92-8b01-67c778ce1fae tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created volume successfully.
Sep 23 00:34:20 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d" returned: 0 in 0.418s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:20 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d
Sep 23 00:34:20 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:20 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1073741824" returned: 0 in 0.436s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171
Sep 23 00:34:21 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-15149dd2-f713-4087-9681-518e6b03287d" returned: 0 in 0.292s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-quobyte-15149dd2-f713-4087-9681-518e6b03287d" released by "delete_volume" :: held 0.787s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Created reservations ['1baac580-e378-43f6-977c-43ebbbcd229a', 'e733aa62-f12b-4be7-b0ee-74f32c44953e', '60761bf8-f0cc-41f0-84e2-08221b2fcb78', '5f8a0811-f113-46e2-8ada-687f7b4e8475'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:21 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171" returned: 0 in 0.295s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.679s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Creating offline snapshot 5d747f40-4682-4c09-b203-ee35eddcb0de of volume f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Attempting download of 3150f937-853a-4cf2-b0e8-dfcef1f7c31a ((None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}])) to volume d2730e83-94e6-47c1-877f-cfbaec6fe171. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb75eb-6aa3-491c-b3b7-21464645bc30]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b2c9c5-5429-497d-8574-0f6c949eeb7a]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a
Sep 23 00:34:21 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala
Sep 23 00:34:21 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:21 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.410s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Deleted volume successfully.
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-921c7da4-0927-4e9c-9feb-22f6b636c7fb tempest-CreateVolumesFromImageTest-1334806364 None] Lock "cinder-15149dd2-f713-4087-9681-518e6b03287d-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-96a7f219-ca36-4a43-a13c-7bef38ec0830-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-96a7f219-ca36-4a43-a13c-7bef38ec0830-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:21 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala" returned: 0 in 0.441s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-96a7f219-ca36-4a43-a13c-7bef38ec0830" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-96a7f219-ca36-4a43-a13c-7bef38ec0830" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:21 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" returned: 0 in 0.547s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1269a-0aa2-4c48-b2bf-6ce2fd4c3c9a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:21 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de 1G
Sep 23 00:34:21 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala
Sep 23 00:34:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830
Sep 23 00:34:22 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala" returned: 1 in 0.437s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_afhgeala' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2afec16-01da-4722-9eb2-f7bbf0307180]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830" returned: 0 in 0.474s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de 1G" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[106801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830
Sep 23 00:34:22 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:22 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de
Sep 23 00:34:22 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-96a7f219-ca36-4a43-a13c-7bef38ec0830" returned: 0 in 0.388s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-96a7f219-ca36-4a43-a13c-7bef38ec0830" released by "delete_volume" :: held 0.926s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:22 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de is being set with open permissions: ugo+rw
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:22 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de
Sep 23 00:34:22 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD
Sep 23 00:34:22 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:22 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['50d9e614-c25d-4d67-be2d-3c0c1c35ee24', 'c390945c-f3a4-4a22-ad1d-8b308a72d942', '0af274bf-cf40-4562-9432-6510b81a21ee', '074045fc-56f7-4350-9910-81c2e7540ba8'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:23 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de" returned: 0 in 0.391s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] 3150f937-853a-4cf2-b0e8-dfcef1f7c31a was raw, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171
Sep 23 00:34:23 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info
Sep 23 00:34:23 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.376s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:23 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-31197faa-7f16-48fb-be8a-8ee6240ebf20 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-96a7f219-ca36-4a43-a13c-7bef38ec0830-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:23 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info" returned: 0 in 0.345s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info is being set with open permissions: ugo+rw
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info
Sep 23 00:34:23 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171" returned: 0 in 0.663s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3150f937-853a-4cf2-b0e8-dfcef1f7c31a_z3cfyvkadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:34:23 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:23 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1G
Sep 23 00:34:23 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:23 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.info" returned: 0 in 0.327s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-33717c05-0c39-4c0b-98b3-8f1259d5f693 tempest-CinderUnicodeTest-1025507525 None] Create snapshot completed successfully
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6efd15a-ec77-4e4c-9814-780d828b21ae]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:24 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 1G" returned: 0 in 0.471s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Downloaded image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a ((None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}])) to volume d2730e83-94e6-47c1-877f-cfbaec6fe171 successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Temporary image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a for user 675bb21f6aaf4cd4a92ba28bbf3391ad is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Marking volume d2730e83-94e6-47c1-877f-cfbaec6fe171 as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Copying metadata from image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a to d2730e83-94e6-47c1-877f-cfbaec6fe171. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Creating volume glance metadata for volume d2730e83-94e6-47c1-877f-cfbaec6fe171 backed by image 3150f937-853a-4cf2-b0e8-dfcef1f7c31a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ea62ba205f68276393bf188ba2792211', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:34:24 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd
Sep 23 00:34:24 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fda97f-73ad-4001-9676-31f2541af887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2730e83-94e6-47c1-877f-cfbaec6fe171', 'volume_size': 1, 'image_id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea62ba205f68276393bf188ba2792211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0088427ddc34221a235a9aa30d82c67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3553253ab26230174ab314f4e6587993fcb7b6ee41b3282bc1ecefd84d032b476b4a0dea9c28d171255ad17b8c82f0460e606f1f81a6e4670ea3f8ac4b4cfa59', 'id': '3150f937-853a-4cf2-b0e8-dfcef1f7c31a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3150f937-853a-4cf2-b0e8-dfcef1f7c31a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857f461d0d0>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879e3a31-4646-419f-aff3-27c8aec311e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:24 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Volume volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 (d2730e83-94e6-47c1-877f-cfbaec6fe171): created successfully
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879e3a31-4646-419f-aff3-27c8aec311e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Flow 'volume_create_manager' (cc72ecbf-8bf3-4999-bae3-1ae5a1601c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d596a56e-0d9a-4057-a81d-2b23f3e73728 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Created volume successfully.
Sep 23 00:34:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:24 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd
Sep 23 00:34:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Acquiring lock "cinder-d2730e83-94e6-47c1-877f-cfbaec6fe171-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "cinder-d2730e83-94e6-47c1-877f-cfbaec6fe171-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Acquiring lock "cinder-quobyte-d2730e83-94e6-47c1-877f-cfbaec6fe171" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "cinder-quobyte-d2730e83-94e6-47c1-877f-cfbaec6fe171" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" returned: 0 in 0.349s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdadcc84-0810-44af-8b79-274969cd59bc]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-5d747f40-4682-4c09-b203-ee35eddcb0de-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd" released by "delete_volume" :: held 0.935s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-5d747f40-4682-4c09-b203-ee35eddcb0de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-quobyte-5d747f40-4682-4c09-b203-ee35eddcb0de" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-5d747f40-4682-4c09-b203-ee35eddcb0de" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Deleting offline snapshot 5d747f40-4682-4c09-b203-ee35eddcb0de of volume f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] snapshot_file for this snap is: volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:34:25 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171
Sep 23 00:34:25 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9d3aa-ef7d-42a5-9f2d-e31755ab9c35]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['4784bd0e-4ec6-4bbc-8cd0-3f05261fe1a6', 'f1ed9f17-8c96-4f18-bd03-f4d409aa35ac', 'a4e123dd-0ddb-4d70-af94-a591c2b77a55', 'ad39e80a-67fb-410c-860b-be98962dfa8a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:25 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:25 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:25 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de
Sep 23 00:34:25 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:25 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171" returned: 0 in 0.538s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:25 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171
Sep 23 00:34:25 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:25 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.341s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8bfebcc0-966a-4312-8c38-a49ec63c7e4c tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-89748cd6-5045-4a5b-bfc4-d719a5e8f8cd-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:25 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de" returned: 0 in 0.561s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4de9d-3fb2-42ac-b91c-c7e6f880ba63]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-d2730e83-94e6-47c1-877f-cfbaec6fe171" returned: 0 in 0.349s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:26 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "cinder-quobyte-d2730e83-94e6-47c1-877f-cfbaec6fe171" released by "delete_volume" :: held 0.980s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:26 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Created reservations ['5e67ba9a-e6ef-48bd-92cc-a1b1ced56507', '44fe14dd-47b4-4ab6-bffe-e469ca432668', '2d6df5e4-5f33-4613-89a3-2ecd68270621', '7790a5a1-b418-4c70-adbb-87e8a88c5da5'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:26 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:26 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" returned: 0 in 0.612s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de
Sep 23 00:34:26 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" acquired by "delete_volume" :: waited 0.050s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9187d55-a9c8-493e-9b3a-98beaa20f05b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:26 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.537s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Deleted volume successfully.
Sep 23 00:34:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-de547b7a-daf7-450b-ab54-3566cce0bfd5 tempest-VolumeAndVolumeTypeFromImageTest-1223185897 None] Lock "cinder-d2730e83-94e6-47c1-877f-cfbaec6fe171-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b
Sep 23 00:34:27 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:27 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de" returned: 0 in 0.529s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:27 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de
Sep 23 00:34:27 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:27 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" returned: 0 in 0.684s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:27 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b
Sep 23 00:34:27 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:27 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a.5d747f40-4682-4c09-b203-ee35eddcb0de" returned: 0 in 0.457s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-5d747f40-4682-4c09-b203-ee35eddcb0de" released by "_delete_snapshot" :: held 2.356s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" released by "delete_snapshot" :: held 2.398s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Created reservations ['fd8e41d7-badc-463e-9826-a837fdf4364b', '7924c96f-8602-4aeb-9c2a-83c7e7fbd1ef', '5cd64225-9b38-41b6-bf73-b55679cc50e1', 'cd7fd592-4bdf-4ac3-a109-ca80f99e8fcb'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Delete snapshot completed successfully.
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6247f413-b2eb-4851-885f-c036fd6f5ca1 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-5d747f40-4682-4c09-b203-ee35eddcb0de-delete_snapshot" released by "delete_snapshot" :: held 2.610s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" returned: 0 in 0.413s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b" released by "delete_volume" :: held 1.179s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['79798573-0764-4c0f-b20f-e7771ea0a28b', '74dc931b-2646-4b73-a9e5-029bbfcd8bde', '411bfd38-028d-41c4-93ff-a9997765acb5', 'bd457890-4d6c-470b-970c-a2d62a325504'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:28 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:28 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:28 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.381s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:28 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-f6d3e2dd-fa8d-484d-879b-1ad0667d189a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-f6d3e2dd-fa8d-484d-879b-1ad0667d189a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-d2ff9cae-7661-4440-850a-1f069f9317cd tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-90a7f6ef-47ba-4d8e-81f1-7df3772e9a9b-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c068e8e-4657-4001-be11-00869ee5be11]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:28 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a
Sep 23 00:34:28 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[84710522-39fd-4135-8ef5-7b7d3f1c652b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:29 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" returned: 0 in 0.602s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:29 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a
Sep 23 00:34:29 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:29 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c
Sep 23 00:34:29 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Flow 'volume_create_manager' (209b7876-7cc8-4cf7-88e4-e2c2e0b3b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8157b8-5eaa-48b4-8bd6-f8da410f2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8157b8-5eaa-48b4-8bd6-f8da410f2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dede36a-9d11-46b3-b6d8-026c014edaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338ebe1d9ce24afbbe1047506b3250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:29Z,use_quota=True,user_id='dd4e5f2e1b8140aab8535a76f42b26c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86377f25-e11f-445f-980e-0db583784ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86377f25-e11f-445f-980e-0db583784ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83573d75-5009-477c-8ace-b998c1924484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.image.glance [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Creating Keystone auth plugin from conf {{(pid=86631) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 23 00:34:29 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" returned: 0 in 0.430s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-f6d3e2dd-fa8d-484d-879b-1ad0667d189a" released by "delete_volume" :: held 1.125s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Created reservations ['6cb31ac4-3bf8-442e-8ae3-4a25aa888fe6', '6a8168be-9e01-4edc-a56c-72ed1612d474', '3d8bd521-0edc-4b10-9bbd-6a8ca88d7457', 'aa5d7e93-a241-4e84-8c5a-e237c4f2d013'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:29 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" returned: 0 in 0.767s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:29 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c
Sep 23 00:34:29 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:29 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:29 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83573d75-5009-477c-8ace-b998c1924484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dede36a-9d11-46b3-b6d8-026c014edaac', 'volume_name': 'volume-7dede36a-9d11-46b3-b6d8-026c014edaac', 'volume_size': 1, 'image_id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c7c3fe52a4d6059870153088747802', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '338ebe1d9ce24afbbe1047506b3250d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492512e404e9f12feb8a9b6679c0788dc07401ff7003fb7d42efd205ce9a8e5da886257dec7a8de2b9382fe35b756178b71dd8aa4b4420ac27187ed687db0967', 'id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea268770>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce04da1-40dc-428d-a147-dea9b66b4552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce04da1-40dc-428d-a147-dea9b66b4552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164a2e67-6cf9-4d30-815c-aaa3209cbc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:30 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Volume 7dede36a-9d11-46b3-b6d8-026c014edaac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dede36a-9d11-46b3-b6d8-026c014edaac', 'volume_size': 1, 'image_id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c7c3fe52a4d6059870153088747802', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '338ebe1d9ce24afbbe1047506b3250d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492512e404e9f12feb8a9b6679c0788dc07401ff7003fb7d42efd205ce9a8e5da886257dec7a8de2b9382fe35b756178b71dd8aa4b4420ac27187ed687db0967', 'id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea268770>}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Trying to clone 7dede36a-9d11-46b3-b6d8-026c014edaac from image ae70ac4a-f81a-4958-98dc-2ca76065a56f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}]). {{(pid=86631) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 23 00:34:30 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" returned: 0 in 0.457s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c" released by "delete_volume" :: held 1.297s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 23 00:34:30 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 00:34:30 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.467s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Deleted volume successfully.
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ee7d7-0cf5-47b8-a137-a23ac1ad68b1]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['d6442276-d1bb-4f56-8d88-0affcba77d8e', '2b687e76-d34d-4fe7-96c0-57ae2f657817', 'dfb4e550-877d-4ffc-8967-e337aaf4a358', 'f2999db2-aeee-4299-8803-e2ad7a965332'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4084aa81-0394-41cc-b808-4320da0b3578 tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-f6d3e2dd-fa8d-484d-879b-1ad0667d189a-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:30 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:30 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-9770ffd1-2ea3-4fc6-afd1-e8616497f380-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-9770ffd1-2ea3-4fc6-afd1-e8616497f380-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:30 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "cinder-quobyte-9770ffd1-2ea3-4fc6-afd1-e8616497f380" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.374s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-9770ffd1-2ea3-4fc6-afd1-e8616497f380" acquired by "delete_volume" :: waited 0.052s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1b7e5de0-c2cd-4da5-9de9-56a3095d70c9 tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-9d8f906e-5c22-4fe2-b4e1-39757d6e0e3c-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af9c76-b6d4-4707-a7a5-7c4761f0fb36]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:31 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380
Sep 23 00:34:31 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-3d85ddf8-5b0f-4715-8168-59f331517573-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-3d85ddf8-5b0f-4715-8168-59f331517573-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-3d85ddf8-5b0f-4715-8168-59f331517573" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:31 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 1 in 0.597s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Temporary image ae70ac4a-f81a-4958-98dc-2ca76065a56f is fetched for user dd4e5f2e1b8140aab8535a76f42b26c9. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-3d85ddf8-5b0f-4715-8168-59f331517573" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ace55-abd7-4771-a9ee-e9e3f8a76ec6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff75b11a-8d82-46aa-8ce8-cf3979ad2dd2]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380" returned: 0 in 0.646s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:31 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573
Sep 23 00:34:31 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380
Sep 23 00:34:31 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:31 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:31 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9770ffd1-2ea3-4fc6-afd1-e8616497f380" returned: 0 in 0.350s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-quobyte-9770ffd1-2ea3-4fc6-afd1-e8616497f380" released by "delete_volume" :: held 1.067s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:32 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573" returned: 0 in 0.531s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573
Sep 23 00:34:32 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Created reservations ['5693b89e-1d31-4fc9-8a4e-f7d457bad713', 'c7637def-490a-4ed1-9ce4-aeb270abdca1', '4563aa43-6355-41ce-aa0b-1230cc478e91', 'a9e7e818-f81e-412c-954a-0c07e689bfec'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:32 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:32 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3d85ddf8-5b0f-4715-8168-59f331517573" returned: 0 in 0.482s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-3d85ddf8-5b0f-4715-8168-59f331517573" released by "delete_volume" :: held 1.101s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:32 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 1 in 0.567s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dede36a-9d11-46b3-b6d8-026c014edaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338ebe1d9ce24afbbe1047506b3250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:29Z,use_quota=True,user_id='dd4e5f2e1b8140aab8535a76f42b26c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Creating volume 7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:32 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Deleted volume successfully.
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['4204088b-2265-4252-ae58-a3511088b3a6', 'b733b30a-34dd-4a0f-afed-2256b9741dad', '97203dee-22a1-4d02-9396-2562e8cd3ee8', 'e06233e2-40fa-44e6-8be9-d31b987cf8b2'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:32 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1073741824
Sep 23 00:34:32 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0cd63b07-a2d0-4bd3-83d6-0e66aec1b0dc tempest-CinderUnicodeTest-1025507525 None] Lock "cinder-9770ffd1-2ea3-4fc6-afd1-e8616497f380-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:32 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:32 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.356s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-6f0cd5c1-2d19-4b9a-90eb-2b19d1a2e73a tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-3d85ddf8-5b0f-4715-8168-59f331517573-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:33 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1073741824" returned: 0 in 0.643s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac
Sep 23 00:34:33 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-3bb41bc1-68dd-44cf-80bc-1602a06cc886-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-3bb41bc1-68dd-44cf-80bc-1602a06cc886-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "cinder-quobyte-3bb41bc1-68dd-44cf-80bc-1602a06cc886" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:33 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac" returned: 0 in 0.424s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-3bb41bc1-68dd-44cf-80bc-1602a06cc886" acquired by "delete_volume" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Attempting download of ae70ac4a-f81a-4958-98dc-2ca76065a56f ((None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}])) to volume 7dede36a-9d11-46b3-b6d8-026c014edaac. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c921dbd-16ea-47a8-9f77-6747353ca50e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9421fba5-0a3c-4fea-b15d-8f0d0c8c50e5]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886
Sep 23 00:34:34 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl
Sep 23 00:34:34 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886" returned: 0 in 0.582s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886
Sep 23 00:34:34 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl" returned: 0 in 0.555s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl
Sep 23 00:34:34 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (b9fcc495-de81-454e-9435-bf6f2797d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b55dc7-5fd6-4b0b-996c-8134f9cb663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b55dc7-5fd6-4b0b-996c-8134f9cb663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152679881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33d21d-3961-41c9-97a6-5eed28a8ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef1e481-822b-43c1-bb16-321b07848087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef1e481-822b-43c1-bb16-321b07848087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4adbfc5-1738-434d-934a-ade0d69f1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4adbfc5-1738-434d-934a-ade0d69f1e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c33d21d-3961-41c9-97a6-5eed28a8ff99', 'volume_name': 'volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4339eb2-95e4-4b63-a75a-c1195d4f6769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4339eb2-95e4-4b63-a75a-c1195d4f6769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39915dd2-7795-4f3b-ae41-efc78532ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:34 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume 9c33d21d-3961-41c9-97a6-5eed28a8ff99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99', 'volume_size': 1}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152679881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33d21d-3961-41c9-97a6-5eed28a8ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume 9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:34 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:34 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-3bb41bc1-68dd-44cf-80bc-1602a06cc886" returned: 0 in 0.452s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-quobyte-3bb41bc1-68dd-44cf-80bc-1602a06cc886" released by "delete_volume" :: held 1.113s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:34 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 1073741824
Sep 23 00:34:34 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl" returned: 1 in 0.489s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae70ac4a-f81a-4958-98dc-2ca76065a56f_cavtotkl' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c2643c-7c85-4387-ac09-935a90d8feec]: (4, 'raw') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Created reservations ['a3521d49-8963-499c-8e44-f4c9ea7015b9', '9c829c34-7608-4621-9673-288dee402c42', 'ef64872b-c907-4572-8c57-5944f3437bb5', 'ab9f7e4a-3715-4b9f-9683-f6d152d076d3'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:35 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:35 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.338s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:35 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Deleted volume successfully.
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5711e590-30a8-4e92-8aa6-a4b69f748a9d tempest-CreateVolumesFromSourceVolumeTest-906553571 None] Lock "cinder-3bb41bc1-68dd-44cf-80bc-1602a06cc886-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:35 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 1073741824" returned: 0 in 0.695s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD
Sep 23 00:34:35 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99
Sep 23 00:34:35 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:35 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] ae70ac4a-f81a-4958-98dc-2ca76065a56f was raw, converting to qcow2 {{(pid=86631) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 23 00:34:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:35 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac
Sep 23 00:34:35 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:36 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39915dd2-7795-4f3b-ae41-efc78532ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dba808-22f6-4ffd-bb14-b97c27363b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:36 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 (9c33d21d-3961-41c9-97a6-5eed28a8ff99): created successfully
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dba808-22f6-4ffd-bb14-b97c27363b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (b9fcc495-de81-454e-9435-bf6f2797d62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b9f2f03d-f224-40ec-9069-b8eb29b555e2 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:36 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac" returned: 0 in 0.638s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae70ac4a-f81a-4958-98dc-2ca76065a56f_jwm4cj7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:34:36 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 00:34:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:36 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1G
Sep 23 00:34:36 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac 1G" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Downloaded image ae70ac4a-f81a-4958-98dc-2ca76065a56f ((None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}])) to volume 7dede36a-9d11-46b3-b6d8-026c014edaac successfully. {{(pid=86631) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Temporary image ae70ac4a-f81a-4958-98dc-2ca76065a56f for user dd4e5f2e1b8140aab8535a76f42b26c9 is deleted. {{(pid=86631) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.volume_utils [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Marking volume 7dede36a-9d11-46b3-b6d8-026c014edaac as bootable. {{(pid=86631) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Copying metadata from image ae70ac4a-f81a-4958-98dc-2ca76065a56f to 7dede36a-9d11-46b3-b6d8-026c014edaac. {{(pid=86631) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Creating volume glance metadata for volume 7dede36a-9d11-46b3-b6d8-026c014edaac backed by image ae70ac4a-f81a-4958-98dc-2ca76065a56f with: {'image_id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '16c7c3fe52a4d6059870153088747802', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86631) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164a2e67-6cf9-4d30-815c-aaa3209cbc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dede36a-9d11-46b3-b6d8-026c014edaac', 'volume_size': 1, 'image_id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c7c3fe52a4d6059870153088747802', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '338ebe1d9ce24afbbe1047506b3250d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492512e404e9f12feb8a9b6679c0788dc07401ff7003fb7d42efd205ce9a8e5da886257dec7a8de2b9382fe35b756178b71dd8aa4b4420ac27187ed687db0967', 'id': 'ae70ac4a-f81a-4958-98dc-2ca76065a56f', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae70ac4a-f81a-4958-98dc-2ca76065a56f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7857ea268770>}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737ef410-63b3-44b2-93bc-1ca2a946e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Volume volume-7dede36a-9d11-46b3-b6d8-026c014edaac (7dede36a-9d11-46b3-b6d8-026c014edaac): created successfully
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737ef410-63b3-44b2-93bc-1ca2a946e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Flow 'volume_create_manager' (209b7876-7cc8-4cf7-88e4-e2c2e0b3b23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:37 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-966d021d-9d1f-4b48-b4f9-fda581232d07 tempest-VolumeImageDependencyTests-80065964 None] Created volume successfully.
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating offline snapshot e1f7806a-08d2-4d5e-b573-980dd4ada005 of volume 9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b24fe-da94-426d-8e3c-8b1c23e5a937]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99
Sep 23 00:34:37 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-092ce589-7a67-4445-bd05-e459edf1176a tempest-ProjectAdminTests-681154313 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86631) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 23 00:34:37 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:37 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 1G
Sep 23 00:34:37 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Acquiring lock "cinder-7dede36a-9d11-46b3-b6d8-026c014edaac-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "cinder-7dede36a-9d11-46b3-b6d8-026c014edaac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Acquiring lock "cinder-quobyte-7dede36a-9d11-46b3-b6d8-026c014edaac" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "cinder-quobyte-7dede36a-9d11-46b3-b6d8-026c014edaac" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e335fec9-84db-4955-b82b-fb33d39b2690]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:38 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 1G" returned: 0 in 0.686s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:38 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac
Sep 23 00:34:38 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:38 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005
Sep 23 00:34:38 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005" returned: 0 in 0.383s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 is being set with open permissions: ugo+rw
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac" returned: 0 in 0.517s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005
Sep 23 00:34:39 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac
Sep 23 00:34:39 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005" returned: 0 in 0.370s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7dede36a-9d11-46b3-b6d8-026c014edaac" returned: 0 in 0.379s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "cinder-quobyte-7dede36a-9d11-46b3-b6d8-026c014edaac" released by "delete_volume" :: held 0.955s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info
Sep 23 00:34:39 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Created reservations ['f734451e-75dc-4a92-9fc8-ae4dba1fe8e7', '0349ff76-e1cc-46cd-b533-912063349138', 'e810ef0c-f045-4514-b433-6f922c6cf2d9', 'e813ac37-b261-43fd-84cc-c3ac89c04cd6'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:39 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:39 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info" returned: 0 in 0.338s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:39 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info is being set with open permissions: ugo+rw
Sep 23 00:34:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:39 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info
Sep 23 00:34:39 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:40 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.339s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Deleted volume successfully.
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-45d4e78f-38bd-4136-81ce-a51d6e9858e1 tempest-VolumeImageDependencyTests-80065964 None] Lock "cinder-7dede36a-9d11-46b3-b6d8-026c014edaac-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:40 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.info" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-55338448-6bc7-412f-9496-d785b79f5605 tempest-CreateVolumesFromSnapshotTest-220060862 None] Create snapshot completed successfully
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Flow 'volume_create_manager' (33d82f8a-e496-49ec-921c-6edf86f29720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff11532a-a3d6-4bdd-9f39-1f52eb04677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff11532a-a3d6-4bdd-9f39-1f52eb04677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1927150066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc643c-2c9f-4858-bc33-f9d2315539f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ecebadc135440eb1ec8b5b4ce12323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:40Z,use_quota=True,user_id='ebdc5e50fc3545c39f7aa4ce78f0f80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feeaa4e-6cd3-4343-933c-c610d63b07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feeaa4e-6cd3-4343-933c-c610d63b07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a42a7d-b9c6-4bd4-bd12-a2ce07631d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a42a7d-b9c6-4bd4-bd12-a2ce07631d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdc643c-2c9f-4858-bc33-f9d2315539f9', 'volume_name': 'volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01088454-193a-4948-9522-6a582199a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01088454-193a-4948-9522-6a582199a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e51ad-5954-473b-bdaa-a1b1265c7f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:40 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Volume 5bdc643c-2c9f-4858-bc33-f9d2315539f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9', 'volume_size': 1}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1927150066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc643c-2c9f-4858-bc33-f9d2315539f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ecebadc135440eb1ec8b5b4ce12323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:40Z,use_quota=True,user_id='ebdc5e50fc3545c39f7aa4ce78f0f80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Creating volume 5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:40 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:40 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 1073741824
Sep 23 00:34:40 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (3ba1cb65-ac7e-48ca-bab0-57d43769b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80952dbf-af31-4a5b-bfd5-719eea4f6660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:41 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 1073741824" returned: 0 in 0.812s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80952dbf-af31-4a5b-bfd5-719eea4f6660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929217392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e955fc-1418-4421-b12e-c9272b77bc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:41Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d95058-8720-4fb0-a4ae-8ad0351c186b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d95058-8720-4fb0-a4ae-8ad0351c186b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711c3375-ea02-4b24-83fd-9818b2c00e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711c3375-ea02-4b24-83fd-9818b2c00e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e955fc-1418-4421-b12e-c9272b77bc18', 'volume_name': 'volume-56e955fc-1418-4421-b12e-c9272b77bc18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39b304e-2ff6-4b8b-ab9d-82d6f3a34f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39b304e-2ff6-4b8b-ab9d-82d6f3a34f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c896439d-13fc-4acb-bb71-09a8333f8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume 56e955fc-1418-4421-b12e-c9272b77bc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e955fc-1418-4421-b12e-c9272b77bc18', 'volume_size': 1}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:41 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:34:41 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (4b789847-379c-458c-b4be-81b99aee71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7613cc-e4fa-47dd-9f30-eae4448d4946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7613cc-e4fa-47dd-9f30-eae4448d4946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264407418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f82688-622b-4a14-8db9-342333053191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:42Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0db75f-2f6c-43f1-a349-931414cc423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0db75f-2f6c-43f1-a349-931414cc423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f400cd-407b-4178-b417-7d50c227a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f400cd-407b-4178-b417-7d50c227a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f82688-622b-4a14-8db9-342333053191', 'volume_name': 'volume-62f82688-622b-4a14-8db9-342333053191', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5cca9b-b350-4d85-a004-25712897a12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5cca9b-b350-4d85-a004-25712897a12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a96708-99fe-4163-9e4e-cd81d74d8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume 62f82688-622b-4a14-8db9-342333053191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f82688-622b-4a14-8db9-342333053191', 'volume_size': 1}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.446s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-929217392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e955fc-1418-4421-b12e-c9272b77bc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:41Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume 56e955fc-1418-4421-b12e-c9272b77bc18 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:42 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e51ad-5954-473b-bdaa-a1b1265c7f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c399cfd-a51c-419f-b1c7-57ec50c72a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 1073741824
Sep 23 00:34:42 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Volume volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 (5bdc643c-2c9f-4858-bc33-f9d2315539f9): created successfully
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c399cfd-a51c-419f-b1c7-57ec50c72a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Flow 'volume_create_manager' (33d82f8a-e496-49ec-921c-6edf86f29720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d2ca08f5-d315-4aaf-bc3f-00b29e72e96d tempest-VolumeDependencyTests-1503915753 None] Created volume successfully.
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (405e0c97-efb6-4d7b-8432-9a957fc3b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a097a17a-b791-4d5b-9202-8dda01d9a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a097a17a-b791-4d5b-9202-8dda01d9a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263807193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819ed9fb-304e-4dff-bf54-36fbfae74202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:43Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141e3071-93c8-4899-9943-afe474322621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141e3071-93c8-4899-9943-afe474322621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6c5b3b-2f63-429a-af39-ef98cc8df848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6c5b3b-2f63-429a-af39-ef98cc8df848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819ed9fb-304e-4dff-bf54-36fbfae74202', 'volume_name': 'volume-819ed9fb-304e-4dff-bf54-36fbfae74202', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee54af1a-eb4f-470f-89a7-cc0870bbe679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee54af1a-eb4f-470f-89a7-cc0870bbe679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced6930e-3bc8-452c-b2e6-e24abe507f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume 819ed9fb-304e-4dff-bf54-36fbfae74202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819ed9fb-304e-4dff-bf54-36fbfae74202', 'volume_size': 1}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 1073741824" returned: 0 in 0.885s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:43 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18
Sep 23 00:34:43 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:43 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18" returned: 0 in 0.373s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264407418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f82688-622b-4a14-8db9-342333053191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:42Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume 62f82688-622b-4a14-8db9-342333053191 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:43 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:43 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 1073741824
Sep 23 00:34:43 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c896439d-13fc-4acb-bb71-09a8333f8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e955fc-1418-4421-b12e-c9272b77bc18', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becc7528-6dba-43a8-80fd-a056185a3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-56e955fc-1418-4421-b12e-c9272b77bc18 (56e955fc-1418-4421-b12e-c9272b77bc18): created successfully
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becc7528-6dba-43a8-80fd-a056185a3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (3ba1cb65-ac7e-48ca-bab0-57d43769b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (4873a10a-7aeb-46ed-809d-2bb231a3e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702cb4af-a6bf-4938-bdff-111811c9ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a4970b30-2035-4d65-83bd-32cefce66f12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702cb4af-a6bf-4938-bdff-111811c9ba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-498745116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27b041e-891f-401d-a92c-f00d766dd084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:43Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490d5d2-ee0a-4bc5-8968-347f1f225d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490d5d2-ee0a-4bc5-8968-347f1f225d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ac4822-9ac4-4083-b3e9-25c551094d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ac4822-9ac4-4083-b3e9-25c551094d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27b041e-891f-401d-a92c-f00d766dd084', 'volume_name': 'volume-b27b041e-891f-401d-a92c-f00d766dd084', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94a066b-9015-4090-8a7c-bab36d88dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94a066b-9015-4090-8a7c-bab36d88dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2b0384-b33f-4d0b-b0d5-b22775fce837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:43 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume b27b041e-891f-401d-a92c-f00d766dd084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27b041e-891f-401d-a92c-f00d766dd084', 'volume_size': 1}
Sep 23 00:34:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (e2a74075-3ffd-4e8c-8518-406ffcc9c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be35614-6fc5-4920-83ae-2b048397fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be35614-6fc5-4920-83ae-2b048397fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296069538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65acb1f-03b8-4d7b-b737-a90ae0430d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c54cf-0431-4986-9010-4c379f8067fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c54cf-0431-4986-9010-4c379f8067fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcd236d-fbdd-4f9c-b5e0-2055e9e064f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcd236d-fbdd-4f9c-b5e0-2055e9e064f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65acb1f-03b8-4d7b-b737-a90ae0430d4b', 'volume_name': 'volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1efe42-7b0b-4ad2-8321-403062d5b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1efe42-7b0b-4ad2-8321-403062d5b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4cd86f-c9f1-4870-8c02-93faa8edac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume b65acb1f-03b8-4d7b-b737-a90ae0430d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b', 'volume_size': 1}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 1073741824" returned: 0 in 0.773s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:44 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191
Sep 23 00:34:44 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:44 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191" returned: 0 in 0.358s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.703s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263807193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819ed9fb-304e-4dff-bf54-36fbfae74202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:43Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume 819ed9fb-304e-4dff-bf54-36fbfae74202 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a96708-99fe-4163-9e4e-cd81d74d8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f82688-622b-4a14-8db9-342333053191', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddbdf06-2a31-4257-873e-17972da196dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:44 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 1073741824
Sep 23 00:34:44 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-62f82688-622b-4a14-8db9-342333053191 (62f82688-622b-4a14-8db9-342333053191): created successfully
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddbdf06-2a31-4257-873e-17972da196dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (4b789847-379c-458c-b4be-81b99aee71a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1508b6e0-38b5-4b24-8129-f3613657de12 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:45 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 1073741824" returned: 0 in 0.591s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:45 devstack sudo[107093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202
Sep 23 00:34:45 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:45 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202" returned: 0 in 0.305s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.924s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Creating offline snapshot 18957ab2-042e-446d-9612-55262e03308b of volume 5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced6930e-3bc8-452c-b2e6-e24abe507f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819ed9fb-304e-4dff-bf54-36fbfae74202', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc67d6d-1f00-4ca6-aee6-b36f7580d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ca3822-c39f-4c45-91df-4f428c8361c0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-819ed9fb-304e-4dff-bf54-36fbfae74202 (819ed9fb-304e-4dff-bf54-36fbfae74202): created successfully
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc67d6d-1f00-4ca6-aee6-b36f7580d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (405e0c97-efb6-4d7b-8432-9a957fc3b172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b6c79557-43a3-42d1-92f2-c54791dac1bd tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:45 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:34:45 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:46 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.477s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:46 devstack sudo[107101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b 1G
Sep 23 00:34:46 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:46 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b 1G" returned: 0 in 0.631s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:46 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:34:46 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:47 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.377s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b is being set with open permissions: ugo+rw
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:47 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:34:47 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:47 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:47 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info
Sep 23 00:34:47 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:47 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info" returned: 0 in 0.279s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:47 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info is being set with open permissions: ugo+rw
Sep 23 00:34:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:47 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info
Sep 23 00:34:47 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:48 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.info" returned: 0 in 0.253s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.273s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-498745116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27b041e-891f-401d-a92c-f00d766dd084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:43Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume b27b041e-891f-401d-a92c-f00d766dd084 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:48 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:48 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 1073741824
Sep 23 00:34:48 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-acb60cf8-1b6f-4cf5-b599-31e623cd2fd9 tempest-VolumeDependencyTests-1503915753 None] Create snapshot completed successfully
Sep 23 00:34:48 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 1073741824" returned: 0 in 0.636s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:48 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084
Sep 23 00:34:48 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:49 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.932s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296069538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65acb1f-03b8-4d7b-b737-a90ae0430d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='305d3ec714d3441c8e0f4bd70854d038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='106796f528734a3fb34f554b5d683fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Creating volume b65acb1f-03b8-4d7b-b737-a90ae0430d4b {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:49 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2b0384-b33f-4d0b-b0d5-b22775fce837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27b041e-891f-401d-a92c-f00d766dd084', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b 1073741824
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5e6407-dd2b-41a6-89a6-ad9f7134c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:49 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-b27b041e-891f-401d-a92c-f00d766dd084 (b27b041e-891f-401d-a92c-f00d766dd084): created successfully
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5e6407-dd2b-41a6-89a6-ad9f7134c12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (4873a10a-7aeb-46ed-809d-2bb231a3e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-62b0c7c1-e832-452d-bb3e-b6df9377bf0c tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Flow 'volume_create_manager' (e789440a-8caa-4241-afad-f3f27c7658ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dfeb2e-bd5f-465b-8864-0f4346a216c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dfeb2e-bd5f-465b-8864-0f4346a216c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-478316008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42589bca-ab52-485c-8823-53f98d5c32af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ecebadc135440eb1ec8b5b4ce12323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18957ab2-042e-446d-9612-55262e03308b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:49Z,use_quota=True,user_id='ebdc5e50fc3545c39f7aa4ce78f0f80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b7c725-df90-47cb-87b0-4500a71fc4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b7c725-df90-47cb-87b0-4500a71fc4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcad127-17d0-48e7-9407-e1bf96e114d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcad127-17d0-48e7-9407-e1bf96e114d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42589bca-ab52-485c-8823-53f98d5c32af', 'volume_name': 'volume-42589bca-ab52-485c-8823-53f98d5c32af', 'volume_size': 1, 'snapshot_id': '18957ab2-042e-446d-9612-55262e03308b'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5064dcd4-04ed-468b-95fd-20f2d362fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5064dcd4-04ed-468b-95fd-20f2d362fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5486ae3-d1d4-490c-a612-60683e083747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:49 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Volume 42589bca-ab52-485c-8823-53f98d5c32af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42589bca-ab52-485c-8823-53f98d5c32af', 'volume_size': 1, 'snapshot_id': '18957ab2-042e-446d-9612-55262e03308b'}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:49 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b 1073741824" returned: 0 in 0.706s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:49 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b
Sep 23 00:34:49 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:50 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" returned: 0 in 0.289s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.559s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b-42589bca-ab52-485c-8823-53f98d5c32af" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4cd86f-c9f1-4870-8c02-93faa8edac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92831f70-c367-477c-8fff-d88c6848c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b-42589bca-ab52-485c-8823-53f98d5c32af" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Creating volume 42589bca-ab52-485c-8823-53f98d5c32af from snapshot 18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Volume volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b (b65acb1f-03b8-4d7b-b737-a90ae0430d4b): created successfully
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92831f70-c367-477c-8fff-d88c6848c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Flow 'volume_create_manager' (e2a74075-3ffd-4e8c-8518-406ffcc9c864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:50 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5343caec-5cce-44a4-925b-397551937691 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created volume successfully.
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] snapshot: 18957ab2-042e-446d-9612-55262e03308b, volume: 42589bca-ab52-485c-8823-53f98d5c32af,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfce9aa-e584-4ed4-9f6b-b7e76635346f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:50 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:34:50 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-b65acb1f-03b8-4d7b-b737-a90ae0430d4b-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:51 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-b65acb1f-03b8-4d7b-b737-a90ae0430d4b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.572s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76c5b5-94ca-40ec-90d2-11ce352a181a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93586dd-9541-492c-99ac-fce743d4409d]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:34:51 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b
Sep 23 00:34:51 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.554s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af
Sep 23 00:34:51 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:51 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" returned: 0 in 0.569s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:51 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b
Sep 23 00:34:51 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:52 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" returned: 0 in 0.357s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-b65acb1f-03b8-4d7b-b737-a90ae0430d4b" released by "delete_volume" :: held 1.006s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['8d927d7f-9f30-4f91-993d-b63d96b005bf', '70afdcb9-79ea-4531-ae2b-b6a83dabb189', '226cf7e6-bcad-49f0-b7db-e8fa0d71cc23', 'c5852a00-6233-44dd-afd8-99bf17613e2a'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:52 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:52 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:52 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.530s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:52 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-9bdb4aab-6630-4290-a400-2b64cdcb8a4d tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-b65acb1f-03b8-4d7b-b737-a90ae0430d4b-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-b27b041e-891f-401d-a92c-f00d766dd084-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-b27b041e-891f-401d-a92c-f00d766dd084-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-b27b041e-891f-401d-a92c-f00d766dd084" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-b27b041e-891f-401d-a92c-f00d766dd084" acquired by "delete_volume" :: waited 0.040s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9db9909-4d82-4cae-98a8-cb1cfa2e3cc2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084
Sep 23 00:34:54 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:54 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084" returned: 0 in 0.807s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:54 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084
Sep 23 00:34:54 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:55 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-b27b041e-891f-401d-a92c-f00d766dd084" returned: 0 in 0.722s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-b27b041e-891f-401d-a92c-f00d766dd084" released by "delete_volume" :: held 1.674s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['08600473-1abe-4911-99b4-f92e9754ad25', '3987a83d-6bd4-44bb-8e78-0d7fb8f416eb', '70c6f018-dfaf-47ea-ac9e-e03941b959db', '101a036a-2604-4c75-bcb3-e17dfefda09b'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:55 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:55 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:56 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.420s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b009c78d-cfb6-49c2-b5c1-f2b966776c29 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-b27b041e-891f-401d-a92c-f00d766dd084-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-819ed9fb-304e-4dff-bf54-36fbfae74202-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-819ed9fb-304e-4dff-bf54-36fbfae74202-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-819ed9fb-304e-4dff-bf54-36fbfae74202" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-819ed9fb-304e-4dff-bf54-36fbfae74202" acquired by "delete_volume" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[08067e52-56f5-402e-b828-bb4312c2a7f2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:56 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202
Sep 23 00:34:56 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:57 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:57 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202" returned: 0 in 0.960s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:57 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202
Sep 23 00:34:57 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (3903e805-a26c-436c-b0d4-558023294dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30344804-d122-4451-b721-caa2522453f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.791s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30344804-d122-4451-b721-caa2522453f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320010681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b9c996-df0c-4ce6-9654-1061afda9720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e39e5a-8ec1-4dfd-b9e6-f7e9ef313088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e39e5a-8ec1-4dfd-b9e6-f7e9ef313088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c2116c-2fd9-456f-9297-f89967b07578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c2116c-2fd9-456f-9297-f89967b07578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b9c996-df0c-4ce6-9654-1061afda9720', 'volume_name': 'volume-c5b9c996-df0c-4ce6-9654-1061afda9720', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614df3c2-64ed-419e-b0ec-b901c5abaf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614df3c2-64ed-419e-b0ec-b901c5abaf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049a4bf2-aeeb-4273-8d9a-46be1b7c1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:34:57 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Volume c5b9c996-df0c-4ce6-9654-1061afda9720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b9c996-df0c-4ce6-9654-1061afda9720', 'volume_size': 1}
Sep 23 00:34:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:57 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-819ed9fb-304e-4dff-bf54-36fbfae74202" returned: 0 in 0.694s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-819ed9fb-304e-4dff-bf54-36fbfae74202" released by "delete_volume" :: held 1.773s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['3caf2c33-1691-4519-aaca-acb8cf03ff45', 'd688a2dc-6e7b-44ae-9c3b-fc36ac53b844', 'f1a06f14-f721-4253-86cb-50aca38b5995', '9561af0c-3743-45c3-b450-bba257c8f0b7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:58 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:34:58 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-62f82688-622b-4a14-8db9-342333053191-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:58 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-62f82688-622b-4a14-8db9-342333053191-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-62f82688-622b-4a14-8db9-342333053191" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:34:59 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-62f82688-622b-4a14-8db9-342333053191" acquired by "delete_volume" :: waited 0.043s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.772s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:34:59 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8a6cc6-40c8-44b7-8691-22c853548761]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:34:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-efb38372-c708-499a-bce3-00031cc233e1 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-819ed9fb-304e-4dff-bf54-36fbfae74202-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:34:59 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191
Sep 23 00:34:59 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:00 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191" returned: 0 in 0.941s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:00 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191
Sep 23 00:35:00 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:00 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-62f82688-622b-4a14-8db9-342333053191" returned: 0 in 0.406s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-62f82688-622b-4a14-8db9-342333053191" released by "delete_volume" :: held 1.485s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['a151bd3d-a0dd-44b2-ab36-c9d1a850030d', '6d5151e1-371f-4659-9b07-2c540b16d661', '9cf8c781-9168-4ce1-8a66-ad8e79baed29', '3128833c-aec5-4834-a96a-727fc1197176'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:01 devstack sudo[107247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:01 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-56e955fc-1418-4421-b12e-c9272b77bc18-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-56e955fc-1418-4421-b12e-c9272b77bc18-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=235,cinder:SELECT=182,cinder:DELETE=26,cinder:INSERT=69 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:35:01 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af" returned: 0 in 9.894s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:35:01 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Converted 1024.00 MB image at 103.46 MB/s
Sep 23 00:35:01 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af is being set with open permissions: ugo+rw
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:01 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.643s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:01 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af
Sep 23 00:35:01 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-56e955fc-1418-4421-b12e-c9272b77bc18" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-56e955fc-1418-4421-b12e-c9272b77bc18" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ac05883c-d0e1-42fa-9fdd-9d0085c8efd4 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-62f82688-622b-4a14-8db9-342333053191-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79cb43d-75a8-477a-beae-0f67feaa5424]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:01 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18
Sep 23 00:35:01 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:01 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af" returned: 0 in 0.332s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" released by "_copy_volume_from_snapshot" :: held 11.500s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=160,cinder:UPDATE=230,cinder:INSERT=55,cinder:DELETE=18 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b-42589bca-ab52-485c-8823-53f98d5c32af" released by "_create_volume_from_snapshot" :: held 11.670s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.738s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.044s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320010681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b9c996-df0c-4ce6-9654-1061afda9720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Creating volume c5b9c996-df0c-4ce6-9654-1061afda9720 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:02 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 1073741824
Sep 23 00:35:02 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5486ae3-d1d4-490c-a612-60683e083747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42589bca-ab52-485c-8823-53f98d5c32af', 'volume_size': 1, 'snapshot_id': '18957ab2-042e-446d-9612-55262e03308b'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d01d4b-a99a-4a5b-9b1e-6f92d5d862eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Volume volume-42589bca-ab52-485c-8823-53f98d5c32af (42589bca-ab52-485c-8823-53f98d5c32af): created successfully
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d01d4b-a99a-4a5b-9b1e-6f92d5d862eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Flow 'volume_create_manager' (e789440a-8caa-4241-afad-f3f27c7658ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-05b16764-140f-40b1-bae8-9e4c54654ee1 tempest-VolumeDependencyTests-1503915753 None] Created volume successfully.
Sep 23 00:35:02 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18" returned: 0 in 0.590s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18
Sep 23 00:35:02 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:02 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-56e955fc-1418-4421-b12e-c9272b77bc18" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-56e955fc-1418-4421-b12e-c9272b77bc18" released by "delete_volume" :: held 0.964s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:02 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 1073741824" returned: 0 in 0.639s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['d98b2f72-a3ca-4408-a6ae-1b4c10061650', 'eb139271-e76e-4aa4-bd59-6d0c800793db', '646bbe50-2cac-4098-acba-61d45e4e2624', 'b1f0b211-b806-415c-83d6-ade7d02f1285'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720
Sep 23 00:35:02 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:02 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:02 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:03 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720" returned: 0 in 0.335s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049a4bf2-aeeb-4273-8d9a-46be1b7c1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b9c996-df0c-4ce6-9654-1061afda9720', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a46de33-7095-4a62-bcd1-990bec27c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:03 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Volume volume-c5b9c996-df0c-4ce6-9654-1061afda9720 (c5b9c996-df0c-4ce6-9654-1061afda9720): created successfully
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a46de33-7095-4a62-bcd1-990bec27c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (3903e805-a26c-436c-b0d4-558023294dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:03 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5e5ac1ff-c72d-4ef3-8707-46c21b6dfdf7 tempest-ProjectReaderTests-263494006 None] Created volume successfully.
Sep 23 00:35:03 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.366s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:03 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e17e043e-de12-42b6-8261-110c5a317ddf tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-56e955fc-1418-4421-b12e-c9272b77bc18-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-18957ab2-042e-446d-9612-55262e03308b-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-18957ab2-042e-446d-9612-55262e03308b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Deleting offline snapshot 18957ab2-042e-446d-9612-55262e03308b of volume 5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] snapshot_file for this snap is: volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fdc51b-2488-4dcf-be9d-0d22c857c6eb]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:03 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:35:03 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-e1f7806a-08d2-4d5e-b573-980dd4ada005-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-e1f7806a-08d2-4d5e-b573-980dd4ada005-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-e1f7806a-08d2-4d5e-b573-980dd4ada005" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-e1f7806a-08d2-4d5e-b573-980dd4ada005" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleting offline snapshot e1f7806a-08d2-4d5e-b573-980dd4ada005 of volume 9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] snapshot_file for this snap is: volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:03 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab0066-3ff6-43eb-8397-afb824e817de]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.551s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7bb63e-173d-4249-98ff-a9aa54c0e0b2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005
Sep 23 00:35:04 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:35:04 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005" returned: 0 in 0.614s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-c5b9c996-df0c-4ce6-9654-1061afda9720-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df26073-b163-4e35-9601-4394bcf3207e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "cinder-c5b9c996-df0c-4ce6-9654-1061afda9720-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (5a40d6b0-b529-4055-add7-7107059d860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cc0b7f-ea8e-4f1f-bb03-133507ec1354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cc0b7f-ea8e-4f1f-bb03-133507ec1354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398008534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e66e084-7a63-49ce-8239-ee494021d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:04Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0be005a-8eea-424d-a16b-fd3b6d90881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0be005a-8eea-424d-a16b-fd3b6d90881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a08d79-b2d4-47d6-af13-10aacfa46f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:04 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99
Sep 23 00:35:04 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a08d79-b2d4-47d6-af13-10aacfa46f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e66e084-7a63-49ce-8239-ee494021d5eb', 'volume_name': 'volume-7e66e084-7a63-49ce-8239-ee494021d5eb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d04de8-ca6d-46fd-a7d8-20462a9d3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d04de8-ca6d-46fd-a7d8-20462a9d3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eb2f22-6ea5-4211-88d2-6efc68f8d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:04 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Volume 7e66e084-7a63-49ce-8239-ee494021d5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e66e084-7a63-49ce-8239-ee494021d5eb', 'volume_size': 1}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398008534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e66e084-7a63-49ce-8239-ee494021d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:04Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Creating volume 7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:04 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.785s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:04 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb 1073741824
Sep 23 00:35:04 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-quobyte-c5b9c996-df0c-4ce6-9654-1061afda9720" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:04 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-c5b9c996-df0c-4ce6-9654-1061afda9720" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f50346-71df-41e9-90d3-3d31a670a3bb]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99" returned: 0 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720
Sep 23 00:35:05 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005
Sep 23 00:35:05 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.457s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b
Sep 23 00:35:05 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb 1073741824" returned: 0 in 0.529s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb
Sep 23 00:35:05 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720" returned: 0 in 0.573s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720
Sep 23 00:35:05 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005" returned: 0 in 0.478s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:05 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005
Sep 23 00:35:05 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:05 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9.18957ab2-042e-446d-9612-55262e03308b" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-18957ab2-042e-446d-9612-55262e03308b" released by "_delete_snapshot" :: held 2.359s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" released by "delete_snapshot" :: held 2.383s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:05 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb" returned: 0 in 0.397s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:05 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c5b9c996-df0c-4ce6-9654-1061afda9720" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eb2f22-6ea5-4211-88d2-6efc68f8d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e66e084-7a63-49ce-8239-ee494021d5eb', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ef01dd-c495-4f7e-8973-ea82934dea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-c5b9c996-df0c-4ce6-9654-1061afda9720" released by "delete_volume" :: held 0.972s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Volume volume-7e66e084-7a63-49ce-8239-ee494021d5eb (7e66e084-7a63-49ce-8239-ee494021d5eb): created successfully
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ef01dd-c495-4f7e-8973-ea82934dea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:05 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (5a40d6b0-b529-4055-add7-7107059d860f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99.e1f7806a-08d2-4d5e-b573-980dd4ada005" returned: 0 in 0.323s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-91734d80-c9d1-4399-8e83-112ac7d9fd7c tempest-ProjectReaderTests-355187485 None] Created volume successfully.
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Created reservations ['fc9461a1-c761-44b5-8d8b-549729eb615f', 'fcf7d968-dffa-4924-bc59-edc35f432ef0', '6a75fc85-8db0-4a23-b5b4-76b67ada307d', 'ff28d0b1-2bc5-48c2-9179-e7ca6d39c4b7'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-e1f7806a-08d2-4d5e-b573-980dd4ada005" released by "_delete_snapshot" :: held 2.090s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" released by "delete_snapshot" :: held 2.128s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Created reservations ['a62d3271-694e-40d5-87e7-3d84519950fc', 'f3dee82f-262e-4827-8e06-7921e03e6208', '7b9b6b4a-bb6b-4c44-bc83-c182883352b5', '500b068a-71e0-4065-9695-99af9c6a6a56'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Delete snapshot completed successfully.
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-784b470f-afb6-48f9-837a-a9b2be748ebb tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-18957ab2-042e-446d-9612-55262e03308b-delete_snapshot" released by "delete_snapshot" :: held 2.743s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['5cd8db26-1c7d-4151-864c-96bffc2abd80', 'f9c572f4-ea64-4bca-8f5f-954f31cbe26b', '5dbf0f0c-e9c6-42c5-9e18-a310441a2312', '8b86094e-12ee-4174-956c-54965d344754'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:06 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:06 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Delete snapshot completed successfully.
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-687b439a-7089-4f01-8e9a-4b2f353ca044 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-e1f7806a-08d2-4d5e-b573-980dd4ada005-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Deleted volume successfully.
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-0e84f77e-9344-43b4-8f72-80d5885098fa tempest-ProjectReaderTests-263494006 None] Lock "cinder-c5b9c996-df0c-4ce6-9654-1061afda9720-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-5bdc643c-2c9f-4858-bc33-f9d2315539f9-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-5bdc643c-2c9f-4858-bc33-f9d2315539f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09c548b-4f18-4b66-8e32-1ff9690f56d7]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:06 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:35:06 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Creating offline snapshot 3993e2c8-ee63-4929-97b7-13c68aad49f5 of volume 7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d215f9d-6022-43f9-9c20-127537b70b6b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-9c33d21d-3961-41c9-97a6-5eed28a8ff99-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-9c33d21d-3961-41c9-97a6-5eed28a8ff99-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:07 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb
Sep 23 00:35:07 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f1696-89cf-4791-bbba-700da632686a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.578s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9
Sep 23 00:35:07 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99
Sep 23 00:35:07 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (6a1430ca-b588-4812-8576-6cb93d648093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:07 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f41a9-3814-4ae9-8d9b-f1db5812dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb" returned: 0 in 0.591s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 1G
Sep 23 00:35:07 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f41a9-3814-4ae9-8d9b-f1db5812dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063741767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad21e4-d98e-4d51-a79a-b7c884daa106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:07Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f2f3aa-0cd9-4f8e-8452-445fb8e85d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f2f3aa-0cd9-4f8e-8452-445fb8e85d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c70efe-1396-41c8-ae5a-6495ab7f5f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c70efe-1396-41c8-ae5a-6495ab7f5f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ad21e4-d98e-4d51-a79a-b7c884daa106', 'volume_name': 'volume-47ad21e4-d98e-4d51-a79a-b7c884daa106', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1290dab1-c265-47bd-9019-8075e811e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1290dab1-c265-47bd-9019-8075e811e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b25351-8121-4468-84cc-e526a48a725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Volume 47ad21e4-d98e-4d51-a79a-b7c884daa106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ad21e4-d98e-4d51-a79a-b7c884daa106', 'volume_size': 1}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:07 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5bdc643c-2c9f-4858-bc33-f9d2315539f9" returned: 0 in 0.355s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-5bdc643c-2c9f-4858-bc33-f9d2315539f9" released by "delete_volume" :: held 1.027s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Created reservations ['0552e876-8040-4913-818e-054deaf9c06a', '4c0cf0d7-94cd-455a-a465-e60f46fbbb9f', 'e6015d2e-38c8-46ca-a1d6-d90703e82908', 'b7baa43e-ae87-47f8-8346-ea2bfa5b2dff'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:07 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99" returned: 0 in 0.489s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99
Sep 23 00:35:07 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:07 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:07 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-9c33d21d-3961-41c9-97a6-5eed28a8ff99" returned: 0 in 0.296s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 1G" returned: 0 in 0.535s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e66e084-7a63-49ce-8239-ee494021d5eb -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-quobyte-9c33d21d-3961-41c9-97a6-5eed28a8ff99" released by "delete_volume" :: held 0.904s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:08 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e66e084-7a63-49ce-8239-ee494021d5eb -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5
Sep 23 00:35:08 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Created reservations ['963b23e6-f790-44fe-a758-babc1d2f1119', '4ab1f692-2f95-47a2-9998-5021afecb548', 'e7e9e27b-1be7-415f-b45d-e9f74579e697', '779487b8-3b19-422d-a2c6-19fecc6b9d87'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:08 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.312s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Deleted volume successfully.
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-a888f74d-49be-4a25-a021-0e59161a557d tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-5bdc643c-2c9f-4858-bc33-f9d2315539f9-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:08 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:08 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e66e084-7a63-49ce-8239-ee494021d5eb -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5" returned: 0 in 0.351s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 is being set with open permissions: ugo+rw
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:08 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5
Sep 23 00:35:08 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.262s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Deleted volume successfully.
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-4fdc422d-1034-4c0e-8789-809762626491 tempest-CreateVolumesFromSnapshotTest-220060862 None] Lock "cinder-9c33d21d-3961-41c9-97a6-5eed28a8ff99-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:08 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5" returned: 0 in 0.273s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:08 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info
Sep 23 00:35:08 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-42589bca-ab52-485c-8823-53f98d5c32af-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-42589bca-ab52-485c-8823-53f98d5c32af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee031ac-dcef-4e0f-ba9c-a8843d1a1e17]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info" returned: 0 in 0.301s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info is being set with open permissions: ugo+rw
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af
Sep 23 00:35:09 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info
Sep 23 00:35:09 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.info" returned: 0 in 0.299s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063741767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad21e4-d98e-4d51-a79a-b7c884daa106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:07Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Creating volume 47ad21e4-d98e-4d51-a79a-b7c884daa106 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:09 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af" returned: 0 in 0.455s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 1073741824
Sep 23 00:35:09 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af
Sep 23 00:35:09 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-362ea958-8926-4bbc-8dff-896526372bce tempest-ProjectReaderTests-355187485 None] Create snapshot completed successfully
Sep 23 00:35:09 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-42589bca-ab52-485c-8823-53f98d5c32af" returned: 0 in 0.270s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-quobyte-42589bca-ab52-485c-8823-53f98d5c32af" released by "delete_volume" :: held 0.775s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Created reservations ['8a72c1f9-edbf-478c-8752-7519479fbba8', '6a539fc6-527f-4444-a17d-0b80c8b58e59', '5e7bed4d-a0f4-46b7-bedc-abe4bc05e8a8', '67b13204-c04c-4332-bf4c-ba65f4ba7161'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:09 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:09 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:09 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 1073741824" returned: 0 in 0.572s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:10 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106
Sep 23 00:35:10 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:10 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.328s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Deleted volume successfully.
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-48c8a899-b885-42d1-a362-b97283e8ac0a tempest-VolumeDependencyTests-1503915753 None] Lock "cinder-42589bca-ab52-485c-8823-53f98d5c32af-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:10 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-3993e2c8-ee63-4929-97b7-13c68aad49f5-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106" returned: 0 in 0.444s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-3993e2c8-ee63-4929-97b7-13c68aad49f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b25351-8121-4468-84cc-e526a48a725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ad21e4-d98e-4d51-a79a-b7c884daa106', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8322ff-bc4e-4f2c-a43a-41d59f4ecd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:10 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Volume volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 (47ad21e4-d98e-4d51-a79a-b7c884daa106): created successfully
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8322ff-bc4e-4f2c-a43a-41d59f4ecd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (6a1430ca-b588-4812-8576-6cb93d648093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-3993e2c8-ee63-4929-97b7-13c68aad49f5" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c3b8b95a-7911-4567-832a-f9927f934ab6 tempest-ProjectReaderTests-263494006 None] Created volume successfully.
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-3993e2c8-ee63-4929-97b7-13c68aad49f5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Deleting offline snapshot 3993e2c8-ee63-4929-97b7-13c68aad49f5 of volume 7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] snapshot_file for this snap is: volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[024c0e05-f58c-4049-983e-b8375b8639c2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:10 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5
Sep 23 00:35:10 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:11 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5" returned: 0 in 0.547s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e66e084-7a63-49ce-8239-ee494021d5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65c631-1f21-43a0-905e-5b4f49866e99]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:11 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb
Sep 23 00:35:11 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-47ad21e4-d98e-4d51-a79a-b7c884daa106-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "cinder-47ad21e4-d98e-4d51-a79a-b7c884daa106-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:11 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb" returned: 0 in 0.621s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:11 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5
Sep 23 00:35:11 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-quobyte-47ad21e4-d98e-4d51-a79a-b7c884daa106" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:11 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-47ad21e4-d98e-4d51-a79a-b7c884daa106" acquired by "delete_volume" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a2c31-c657-40e3-9568-815118b8841e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106
Sep 23 00:35:12 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5" returned: 0 in 0.683s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5
Sep 23 00:35:12 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106" returned: 0 in 0.719s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:12 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106
Sep 23 00:35:12 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:12 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb.3993e2c8-ee63-4929-97b7-13c68aad49f5" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-3993e2c8-ee63-4929-97b7-13c68aad49f5" released by "_delete_snapshot" :: held 2.412s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" released by "delete_snapshot" :: held 2.451s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-47ad21e4-d98e-4d51-a79a-b7c884daa106" returned: 0 in 0.351s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-47ad21e4-d98e-4d51-a79a-b7c884daa106" released by "delete_volume" :: held 1.145s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Created reservations ['b19403cb-53fd-415c-ac6b-05cbd0669114', 'ba81308e-6e9f-45d6-aa59-85bfbb5779a6', 'dc53c6a0-d8d6-4360-bc1a-80836a7ebc69', 'e2d61e6c-342e-454d-b8b8-1bd8ed1305b6'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Created reservations ['56f3a49d-4dee-427b-88a7-0caab8ae8d2c', 'd8895839-4102-4646-b0ee-c667184564c9', 'b8409e06-1654-4d22-b453-edb577599a26', '9be97aba-2192-4eb7-a33e-69b15397fee1'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Delete snapshot completed successfully.
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e305f31f-194b-45ac-939a-44b927722fac tempest-ProjectReaderTests-355187485 None] Lock "cinder-3993e2c8-ee63-4929-97b7-13c68aad49f5-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:13 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:13 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:13 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:13 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Deleted volume successfully.
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-7e66e084-7a63-49ce-8239-ee494021d5eb-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "cinder-7e66e084-7a63-49ce-8239-ee494021d5eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-52ef694c-379e-4b9d-adbd-b8120114d4a1 tempest-ProjectReaderTests-263494006 None] Lock "cinder-47ad21e4-d98e-4d51-a79a-b7c884daa106-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0626b-e07d-422c-aeed-a209c4484690]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (2d235962-ce6d-4de0-b5d5-502497b79ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad54d31-8101-40d0-9674-159b7c181345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad54d31-8101-40d0-9674-159b7c181345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158877385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2960d44a-4b7d-4123-9f01-f2bc21f2d01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:14Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a54342b-a2a6-4bbf-8933-959968168f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a54342b-a2a6-4bbf-8933-959968168f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c4085d-cab2-4beb-9ab7-9a9b35d5ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c4085d-cab2-4beb-9ab7-9a9b35d5ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2960d44a-4b7d-4123-9f01-f2bc21f2d01e', 'volume_name': 'volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a1ab4-980d-4ce1-bb47-839e0a5e1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a1ab4-980d-4ce1-bb47-839e0a5e1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb
Sep 23 00:35:14 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ea6784-f168-4e14-80a7-59b4c2e3a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Volume 2960d44a-4b7d-4123-9f01-f2bc21f2d01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e', 'volume_size': 1}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158877385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2960d44a-4b7d-4123-9f01-f2bc21f2d01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:14Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Creating volume 2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:14 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e 1073741824
Sep 23 00:35:14 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:14 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb" returned: 0 in 0.626s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:14 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb
Sep 23 00:35:14 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (95f6388c-7651-4952-9eeb-ce65c82a38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feadcca0-4d18-4b10-a63d-91537005dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feadcca0-4d18-4b10-a63d-91537005dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654604324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f86c4af-1787-4b05-b73f-e67ac079f188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:15Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51f304-d689-4469-9318-cd3655060a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51f304-d689-4469-9318-cd3655060a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293cb3cd-258f-4380-a544-319a8b3b085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293cb3cd-258f-4380-a544-319a8b3b085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f86c4af-1787-4b05-b73f-e67ac079f188', 'volume_name': 'volume-4f86c4af-1787-4b05-b73f-e67ac079f188', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeb76b6-ac5b-4fc2-87f2-f48018e5683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeb76b6-ac5b-4fc2-87f2-f48018e5683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09212f25-9934-4fe5-a84e-c281d9dea5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:14 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Volume 4f86c4af-1787-4b05-b73f-e67ac079f188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f86c4af-1787-4b05-b73f-e67ac079f188', 'volume_size': 1}
Sep 23 00:35:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:15 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e 1073741824" returned: 0 in 0.761s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-7e66e084-7a63-49ce-8239-ee494021d5eb" returned: 0 in 0.440s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e
Sep 23 00:35:15 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-7e66e084-7a63-49ce-8239-ee494021d5eb" released by "delete_volume" :: held 1.160s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Created reservations ['0f7b0900-b888-428a-bf54-0c8a535f4008', '2472d5ea-364c-46ea-bf72-7256f448cea1', 'b2c5c78e-b260-4a0b-8bd8-3a6b6e45a359', 'b4d3939b-7e6e-48a1-933b-537d30a5247f'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:15 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" returned: 0 in 0.316s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654604324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f86c4af-1787-4b05-b73f-e67ac079f188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:15Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Creating volume 4f86c4af-1787-4b05-b73f-e67ac079f188 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:15 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ea6784-f168-4e14-80a7-59b4c2e3a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa67319-0df8-4f11-80a8-04b09a3a2d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:15 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 1073741824
Sep 23 00:35:15 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:15 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Volume volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e (2960d44a-4b7d-4123-9f01-f2bc21f2d01e): created successfully
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa67319-0df8-4f11-80a8-04b09a3a2d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (2d235962-ce6d-4de0-b5d5-502497b79ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e2b5bf8d-75f2-4c48-aaf3-e3ffea8abb79 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:35:15 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.340s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:15 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Deleted volume successfully.
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-04e81e3d-1651-4e7f-92f2-6c570ce64608 tempest-ProjectReaderTests-355187485 None] Lock "cinder-7e66e084-7a63-49ce-8239-ee494021d5eb-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:15 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 1073741824" returned: 0 in 0.601s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188
Sep 23 00:35:16 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188" returned: 0 in 0.341s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09212f25-9934-4fe5-a84e-c281d9dea5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f86c4af-1787-4b05-b73f-e67ac079f188', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3489447-1ea2-47b0-85ea-37f518568b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Volume volume-4f86c4af-1787-4b05-b73f-e67ac079f188 (4f86c4af-1787-4b05-b73f-e67ac079f188): created successfully
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3489447-1ea2-47b0-85ea-37f518568b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (95f6388c-7651-4952-9eeb-ce65c82a38ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:16 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9021338d-6177-4899-b26d-0df277ff5946 tempest-ProjectReaderTests-263494006 None] Created volume successfully.
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot fde87f0f-de2a-4d4b-bbb7-d559fa642209 of volume 2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f5859-30b7-46c5-a3e4-347c8d6e6b82]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:16 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e
Sep 23 00:35:16 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (a0fd8f59-2987-433d-bd38-2513eaab9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b4a81c-ae6b-4671-99c2-71a79beaa9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b4a81c-ae6b-4671-99c2-71a79beaa9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944011103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f6df66-a487-48be-84e5-9abd699581aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a6d393-132c-4f80-ae94-db1fa25646f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a6d393-132c-4f80-ae94-db1fa25646f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c224f708-aa96-45f6-9d85-bd6ef9c828c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c224f708-aa96-45f6-9d85-bd6ef9c828c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f6df66-a487-48be-84e5-9abd699581aa', 'volume_name': 'volume-30f6df66-a487-48be-84e5-9abd699581aa', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7623a1-7628-4e1c-9767-e4dca9ac96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7623a1-7628-4e1c-9767-e4dca9ac96f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e9586c-aea8-458a-8d46-1e4542891b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:16 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Volume 30f6df66-a487-48be-84e5-9abd699581aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f6df66-a487-48be-84e5-9abd699581aa', 'volume_size': 1}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-4f86c4af-1787-4b05-b73f-e67ac079f188-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "cinder-4f86c4af-1787-4b05-b73f-e67ac079f188-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-quobyte-4f86c4af-1787-4b05-b73f-e67ac079f188" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-4f86c4af-1787-4b05-b73f-e67ac079f188" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cf652-31f6-47dd-bce5-98edeb3312db]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" returned: 0 in 0.499s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 1G
Sep 23 00:35:17 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188
Sep 23 00:35:17 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188" returned: 0 in 0.454s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188
Sep 23 00:35:17 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 1G" returned: 0 in 0.591s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:17 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209
Sep 23 00:35:17 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:17 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-4f86c4af-1787-4b05-b73f-e67ac079f188" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-4f86c4af-1787-4b05-b73f-e67ac079f188" released by "delete_volume" :: held 0.853s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:17 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Created reservations ['83d9495a-8141-4126-be8f-64e7460ee818', 'fbd53c5c-665c-4a64-9a29-6a1f1d222189', 'df04ecad-7507-4c91-95ab-09efe577e40a', '671bd1b6-b08b-4b0b-b94e-6773e17eac29'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:18 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209" returned: 0 in 0.419s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 is being set with open permissions: ugo+rw
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209
Sep 23 00:35:18 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.480s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:18 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Deleted volume successfully.
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-eef4a02d-1c2d-48fb-bbb6-44dc549ee829 tempest-ProjectReaderTests-263494006 None] Lock "cinder-4f86c4af-1787-4b05-b73f-e67ac079f188-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:18 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info
Sep 23 00:35:18 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:18 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info" returned: 0 in 0.302s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:18 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info is being set with open permissions: ugo+rw
Sep 23 00:35:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:18 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info
Sep 23 00:35:18 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (ccf1d46d-5256-4719-a307-43ceb2a12250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b765c332-700a-4cce-ba20-c0a105feb6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b765c332-700a-4cce-ba20-c0a105feb6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006416768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1281934e-a357-47c8-b5d0-b75fd7c06cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:19Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe2d4aa-9a4c-4b03-94ea-a02a61fb8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe2d4aa-9a4c-4b03-94ea-a02a61fb8baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679f15d6-2634-4889-8b02-12f9195c2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679f15d6-2634-4889-8b02-12f9195c2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1281934e-a357-47c8-b5d0-b75fd7c06cd5', 'volume_name': 'volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2c7a12-c785-49a3-b8a5-b4ad6d638db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2c7a12-c785-49a3-b8a5-b4ad6d638db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a035e4-2376-45f5-80d3-a88fb8ea5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:19 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Volume 1281934e-a357-47c8-b5d0-b75fd7c06cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5', 'volume_size': 1}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:19 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.info" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.355s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944011103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f6df66-a487-48be-84e5-9abd699581aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Creating volume 30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:19 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa 1073741824
Sep 23 00:35:19 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:19 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9369aa82-fdd2-426f-8e6f-96a2f8faef65 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-fde87f0f-de2a-4d4b-bbb7-d559fa642209-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-fde87f0f-de2a-4d4b-bbb7-d559fa642209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-fde87f0f-de2a-4d4b-bbb7-d559fa642209" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa 1073741824" returned: 0 in 0.523s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-fde87f0f-de2a-4d4b-bbb7-d559fa642209" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot fde87f0f-de2a-4d4b-bbb7-d559fa642209 of volume 2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ee5a0b-1646-4bbe-920b-c57039bf7434]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:19 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa
Sep 23 00:35:19 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209
Sep 23 00:35:20 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006416768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1281934e-a357-47c8-b5d0-b75fd7c06cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077ac7018add447890d67b74fc469427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:19Z,use_quota=True,user_id='02199eaad66c49918c8b162fc465035e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Creating volume 1281934e-a357-47c8-b5d0-b75fd7c06cd5 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:20 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 1073741824
Sep 23 00:35:20 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e9586c-aea8-458a-8d46-1e4542891b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f6df66-a487-48be-84e5-9abd699581aa', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f811b870-9a63-42c9-8a41-27192de034f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:20 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Volume volume-30f6df66-a487-48be-84e5-9abd699581aa (30f6df66-a487-48be-84e5-9abd699581aa): created successfully
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f811b870-9a63-42c9-8a41-27192de034f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (a0fd8f59-2987-433d-bd38-2513eaab9272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:20 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9c2e4c02-3ee6-4572-8b35-0230debe7490 tempest-ProjectReaderTests-355187485 None] Created volume successfully.
Sep 23 00:35:20 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e0f8b-59aa-4cd0-9a8a-08d633218253]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e
Sep 23 00:35:20 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:20 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 1073741824" returned: 0 in 0.626s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" returned: 0 in 0.487s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:20 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5
Sep 23 00:35:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:20 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209
Sep 23 00:35:21 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5" returned: 0 in 0.308s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a035e4-2376-45f5-80d3-a88fb8ea5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c56536-b508-4189-8628-f5ef694af06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:21 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Volume volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 (1281934e-a357-47c8-b5d0-b75fd7c06cd5): created successfully
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c56536-b508-4189-8628-f5ef694af06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Flow 'volume_create_manager' (ccf1d46d-5256-4719-a307-43ceb2a12250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-413241e4-79ae-4127-99dd-8841ae337452 tempest-ProjectReaderTests-263494006 None] Created volume successfully.
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:21 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209" returned: 0 in 0.429s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Creating offline snapshot a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 of volume 30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:21 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209
Sep 23 00:35:21 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f8fa0-8f96-426b-9703-a75d0a9bbe87]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa
Sep 23 00:35:21 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e.fde87f0f-de2a-4d4b-bbb7-d559fa642209" returned: 0 in 0.290s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-fde87f0f-de2a-4d4b-bbb7-d559fa642209" released by "_delete_snapshot" :: held 1.876s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" released by "delete_snapshot" :: held 1.911s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Created reservations ['3b7b140f-d490-4f14-ad78-b936863306c2', '59499636-896c-42a0-b8f0-99452b5c7e21', '38e3c528-71c1-4287-9bb1-ec49307acebd', '0ed8e9ef-e649-4678-ad01-e56001e96995'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:21 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa" returned: 0 in 0.431s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:21 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 1G
Sep 23 00:35:21 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:35:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e160ecc0-c32d-46b6-a7e5-e9dc2c6ae86e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-fde87f0f-de2a-4d4b-bbb7-d559fa642209-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-2960d44a-4b7d-4123-9f01-f2bc21f2d01e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "cinder-2960d44a-4b7d-4123-9f01-f2bc21f2d01e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ecbbd-6c5c-41f9-bf6e-19153c4bf994]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-1281934e-a357-47c8-b5d0-b75fd7c06cd5-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "cinder-1281934e-a357-47c8-b5d0-b75fd7c06cd5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Acquiring lock "cinder-quobyte-1281934e-a357-47c8-b5d0-b75fd7c06cd5" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:22 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e
Sep 23 00:35:22 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-1281934e-a357-47c8-b5d0-b75fd7c06cd5" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ab6ba-a307-4d63-84be-fd8cc9a65864]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 1G" returned: 0 in 0.658s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f6df66-a487-48be-84e5-9abd699581aa -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f6df66-a487-48be-84e5-9abd699581aa -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0
Sep 23 00:35:22 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5
Sep 23 00:35:22 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" returned: 0 in 0.559s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e
Sep 23 00:35:22 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f6df66-a487-48be-84e5-9abd699581aa -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" returned: 0 in 0.382s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 is being set with open permissions: ugo+rw
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0
Sep 23 00:35:22 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:22 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:22 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5
Sep 23 00:35:22 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" returned: 0 in 0.375s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-2960d44a-4b7d-4123-9f01-f2bc21f2d01e" released by "delete_volume" :: held 1.057s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Created reservations ['6f0611a2-67f9-4d65-88ea-b5c0bd6cf66a', 'c3253792-fe2d-420d-adef-444b38e6fbe3', '568cc526-fdcc-4f55-a59f-f629bae4a9e2', '411a5372-65c8-4ab8-8dfc-42161720e7eb'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:23 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1281934e-a357-47c8-b5d0-b75fd7c06cd5" returned: 0 in 0.381s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" returned: 0 in 0.442s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "cinder-quobyte-1281934e-a357-47c8-b5d0-b75fd7c06cd5" released by "delete_volume" :: held 0.979s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info
Sep 23 00:35:23 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Created reservations ['ef92c94b-3626-4466-825a-29a02bfadd51', '818d0a89-9629-43c6-a973-5c50d55160bf', '08da245a-273c-4f46-8aaf-5399ab5e4d58', '860f0221-269d-480c-ba5c-997c0eedafb8'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:23 devstack sudo[107581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:23 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:23 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info" returned: 0 in 0.425s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info is being set with open permissions: ugo+rw
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:23 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info
Sep 23 00:35:23 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:23 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.400s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:23 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:23 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-ebdc3369-b934-45d4-a537-31366f99cbbf tempest-ProjectMemberTests-1829957451 None] Lock "cinder-2960d44a-4b7d-4123-9f01-f2bc21f2d01e-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:24 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.354s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Deleted volume successfully.
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b446e9d0-c07b-427a-9ec0-e8ffd5eabd43 tempest-ProjectReaderTests-263494006 None] Lock "cinder-1281934e-a357-47c8-b5d0-b75fd7c06cd5-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:24 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.info" returned: 0 in 0.342s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:24 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-3472530b-cd65-41ed-a52e-2b913d46e1f1 tempest-ProjectReaderTests-355187485 None] Create snapshot completed successfully
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Deleting offline snapshot a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 of volume 30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:24 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] snapshot_file for this snap is: volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb65f1-4914-47c1-a110-5f357ca9ea8f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (06c18643-6ddc-4552-8e89-9b809ee19937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2109f7f0-5d44-4064-b18d-125435dab960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:25 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0
Sep 23 00:35:25 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2109f7f0-5d44-4064-b18d-125435dab960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156441142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0d3258-73af-4ef2-adca-666e66186522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:25Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52613c2d-e205-4a00-924f-d32a5b569427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52613c2d-e205-4a00-924f-d32a5b569427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d66af9-1604-44a4-8c67-1f5f645d385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d66af9-1604-44a4-8c67-1f5f645d385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0d3258-73af-4ef2-adca-666e66186522', 'volume_name': 'volume-de0d3258-73af-4ef2-adca-666e66186522', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2918f40-310f-4e0f-817c-d8c24b9d9269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2918f40-310f-4e0f-817c-d8c24b9d9269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5d9d4-9d41-4d92-b77a-486d271eb154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:25 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Volume de0d3258-73af-4ef2-adca-666e66186522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0d3258-73af-4ef2-adca-666e66186522', 'volume_size': 1}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156441142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0d3258-73af-4ef2-adca-666e66186522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:25Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Creating volume de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:25 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 1073741824
Sep 23 00:35:25 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" returned: 0 in 0.624s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f6df66-a487-48be-84e5-9abd699581aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d937dff1-f1a7-412b-a504-47d69f588331]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:25 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa
Sep 23 00:35:25 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:25 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 1073741824" returned: 0 in 0.689s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:26 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522
Sep 23 00:35:26 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:26 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa" returned: 0 in 0.516s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:26 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0
Sep 23 00:35:26 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:26 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522" returned: 0 in 0.367s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f5d9d4-9d41-4d92-b77a-486d271eb154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0d3258-73af-4ef2-adca-666e66186522', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad84324-189e-4edb-9743-f93e7c631526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:26 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Volume volume-de0d3258-73af-4ef2-adca-666e66186522 (de0d3258-73af-4ef2-adca-666e66186522): created successfully
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad84324-189e-4edb-9743-f93e7c631526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (06c18643-6ddc-4552-8e89-9b809ee19937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-9146f212-97e5-4a5d-be2d-3598c5461a49 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:35:26 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" returned: 0 in 0.626s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:26 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0
Sep 23 00:35:26 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:27 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa.a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" returned: 0 in 0.308s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0" released by "_delete_snapshot" :: held 2.239s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" released by "delete_snapshot" :: held 2.277s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Created reservations ['4f45fb55-1b72-4a08-ba9b-6d0668108b47', 'c4288e0a-ce3d-448d-8a4c-b6bbc50e1da4', 'b6c8edf4-1db9-4c61-acdf-494002fd52c4', '51046cbd-0f91-4926-9ce2-57fc1b1d9c02'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Delete snapshot completed successfully.
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-388a534f-0b41-46c0-9b39-0b5051afa039 tempest-ProjectReaderTests-355187485 None] Lock "cinder-a20fc6da-efa0-4b8b-a31a-2c6be7351ad0-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 9f06635a-b9a0-4c88-a12c-c86e5d16713a of volume de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51272eb-a0c0-4d6b-bec2-ba949de425e1]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:27 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522
Sep 23 00:35:27 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522" returned: 0 in 0.504s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a 1G
Sep 23 00:35:28 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-30f6df66-a487-48be-84e5-9abd699581aa-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "cinder-30f6df66-a487-48be-84e5-9abd699581aa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d51b70b-dd02-4f40-b9c5-bf3ce19c74c0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa
Sep 23 00:35:28 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a 1G" returned: 0 in 0.640s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0d3258-73af-4ef2-adca-666e66186522 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:28 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0d3258-73af-4ef2-adca-666e66186522 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a
Sep 23 00:35:28 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:28 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa" returned: 0 in 0.497s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa
Sep 23 00:35:29 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0d3258-73af-4ef2-adca-666e66186522 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a" returned: 0 in 0.407s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a is being set with open permissions: ugo+rw
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a
Sep 23 00:35:29 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-30f6df66-a487-48be-84e5-9abd699581aa" returned: 0 in 0.379s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-30f6df66-a487-48be-84e5-9abd699581aa" released by "delete_volume" :: held 0.999s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Created reservations ['494eec16-cbf9-4ae5-8867-507036726366', '278ba4ea-9e2b-4cac-9145-644e605cd1ae', 'ebe0104d-2e00-4ca8-808b-cbbbfbd920a1', '871fe372-8e40-4f26-8f34-6c7e963cb435'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:29 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a" returned: 0 in 0.422s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:29 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:29 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info
Sep 23 00:35:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:29 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:29 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Deleted volume successfully.
Sep 23 00:35:29 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5cd7262-3afc-49e4-844f-23e5b61d9062 tempest-ProjectReaderTests-355187485 None] Lock "cinder-30f6df66-a487-48be-84e5-9abd699581aa-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info" returned: 0 in 0.308s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info is being set with open permissions: ugo+rw
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:30 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info
Sep 23 00:35:30 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:30 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.info" returned: 0 in 0.311s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e6a804f7-cfd3-45ed-8fc5-8ce77a5b1792 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-9f06635a-b9a0-4c88-a12c-c86e5d16713a-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-9f06635a-b9a0-4c88-a12c-c86e5d16713a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-9f06635a-b9a0-4c88-a12c-c86e5d16713a" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-9f06635a-b9a0-4c88-a12c-c86e5d16713a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 9f06635a-b9a0-4c88-a12c-c86e5d16713a of volume de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:30 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6ca6b-e83f-417f-a0dd-5c88b343cce9]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a
Sep 23 00:35:31 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (f116fa82-fc82-4091-a0af-b41bc5d7dcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78966f0c-a2d5-4784-b110-5695c8662dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78966f0c-a2d5-4784-b110-5695c8662dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330614425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c005199-a9c8-493c-a4ed-3105853d0658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:31Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5a919d-0ba8-4a30-89a0-b5cacd6aa6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5a919d-0ba8-4a30-89a0-b5cacd6aa6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729e58b1-cb87-400b-8b3b-0a75fb144eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729e58b1-cb87-400b-8b3b-0a75fb144eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c005199-a9c8-493c-a4ed-3105853d0658', 'volume_name': 'volume-6c005199-a9c8-493c-a4ed-3105853d0658', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff16108-7be9-4ef1-93dc-2ac017651e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff16108-7be9-4ef1-93dc-2ac017651e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2a9b60-f417-4599-a747-f752b4b521d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:31 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Volume 6c005199-a9c8-493c-a4ed-3105853d0658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c005199-a9c8-493c-a4ed-3105853d0658', 'volume_size': 1}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330614425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c005199-a9c8-493c-a4ed-3105853d0658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:31Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Creating volume 6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:31 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 1073741824
Sep 23 00:35:31 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:31 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a" returned: 0 in 0.547s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0d3258-73af-4ef2-adca-666e66186522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917659f-c9a2-4e9b-bc57-42d5ba29b739]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:31 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522
Sep 23 00:35:31 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a
Sep 23 00:35:32 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 1073741824" returned: 0 in 0.703s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658
Sep 23 00:35:32 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a" returned: 0 in 0.557s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:32 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658" returned: 0 in 0.453s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:32 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a
Sep 23 00:35:32 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2a9b60-f417-4599-a747-f752b4b521d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c005199-a9c8-493c-a4ed-3105853d0658', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ae1485-124f-447e-a868-d0c57a8dbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Volume volume-6c005199-a9c8-493c-a4ed-3105853d0658 (6c005199-a9c8-493c-a4ed-3105853d0658): created successfully
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ae1485-124f-447e-a868-d0c57a8dbce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (f116fa82-fc82-4091-a0af-b41bc5d7dcdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:32 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7b7dc26c-3206-4143-9076-dc733462f528 tempest-ProjectReaderTests-355187485 None] Created volume successfully.
Sep 23 00:35:32 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522.9f06635a-b9a0-4c88-a12c-c86e5d16713a" returned: 0 in 0.306s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-9f06635a-b9a0-4c88-a12c-c86e5d16713a" released by "_delete_snapshot" :: held 2.102s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" released by "delete_snapshot" :: held 2.134s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Created reservations ['bb3464c7-2162-471e-b778-73963661efdf', '986814d5-2b78-4abb-9f56-37f74003a120', '1b279e17-d596-4429-b01b-fb4becdc5a38', '4166704e-6200-4c99-8f4d-dd1008322f94'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7d780db8-10ef-434d-8c8e-8ddbc0373849 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-9f06635a-b9a0-4c88-a12c-c86e5d16713a-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Creating offline snapshot 0411719c-4b56-4998-81f0-62480270ed9f of volume 6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bd6853-2136-4b95-9dec-1cfcd8fbf2e2]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:33 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658
Sep 23 00:35:33 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658" returned: 0 in 0.484s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f 1G
Sep 23 00:35:34 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-de0d3258-73af-4ef2-adca-666e66186522-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-de0d3258-73af-4ef2-adca-666e66186522-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" acquired by "delete_volume" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[25221d57-4338-4fdd-b522-08246d781482]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522
Sep 23 00:35:34 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:34 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f 1G" returned: 0 in 0.679s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c005199-a9c8-493c-a4ed-3105853d0658 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:34 devstack sudo[107702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c005199-a9c8-493c-a4ed-3105853d0658 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f
Sep 23 00:35:34 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522" returned: 0 in 0.664s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522
Sep 23 00:35:35 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c005199-a9c8-493c-a4ed-3105853d0658 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f" returned: 0 in 0.530s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f is being set with open permissions: ugo+rw
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f
Sep 23 00:35:35 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-de0d3258-73af-4ef2-adca-666e66186522" returned: 0 in 0.463s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-de0d3258-73af-4ef2-adca-666e66186522" released by "delete_volume" :: held 1.254s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Created reservations ['64b61560-01c6-454e-bf57-b4966c9f409c', 'fc77d638-33f7-4356-8684-41f0e406c921', 'bf6932ec-c16a-4e11-9c7e-ee2b83c7967a', '03f54686-9029-466c-a31c-d93f30f38415'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:35 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f" returned: 0 in 0.409s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info
Sep 23 00:35:35 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:35 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:35 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:36 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info" returned: 0 in 0.367s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info is being set with open permissions: ugo+rw
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:36 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info
Sep 23 00:35:36 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:36 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.378s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-e5b98854-aee9-4fd5-8bbd-b19a63806c1e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-de0d3258-73af-4ef2-adca-666e66186522-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:36 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.info" returned: 0 in 0.502s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2b78c360-81cf-474d-8c25-3a34f08bb9da tempest-ProjectReaderTests-355187485 None] Create snapshot completed successfully
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (4bbae384-5645-452f-ad60-b31090d181ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7597cff0-84c8-452b-a6bb-69dab2f7cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7597cff0-84c8-452b-a6bb-69dab2f7cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132379208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e393d5ca-931b-444d-9733-ab2a778efed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:37Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdac895e-e6b3-414e-b3a4-23931d0af398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdac895e-e6b3-414e-b3a4-23931d0af398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da41b7b-a24b-4324-8f69-cc93a751a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da41b7b-a24b-4324-8f69-cc93a751a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e393d5ca-931b-444d-9733-ab2a778efed2', 'volume_name': 'volume-e393d5ca-931b-444d-9733-ab2a778efed2', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc1ad59-a4e7-4a87-b9c8-b8d21dd3dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc1ad59-a4e7-4a87-b9c8-b8d21dd3dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ebb31-67f8-4ec5-a641-502fa7aad505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:37 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Volume e393d5ca-931b-444d-9733-ab2a778efed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e393d5ca-931b-444d-9733-ab2a778efed2', 'volume_size': 1}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132379208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e393d5ca-931b-444d-9733-ab2a778efed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:37Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Creating volume e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:37 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:37 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 1073741824
Sep 23 00:35:37 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-0411719c-4b56-4998-81f0-62480270ed9f-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-0411719c-4b56-4998-81f0-62480270ed9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-0411719c-4b56-4998-81f0-62480270ed9f" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0411719c-4b56-4998-81f0-62480270ed9f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Deleting offline snapshot 0411719c-4b56-4998-81f0-62480270ed9f of volume 6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] snapshot_file for this snap is: volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5c0a0-e17c-4e84-8cae-e3de33fbb016]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 1073741824" returned: 0 in 0.706s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f
Sep 23 00:35:38 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2
Sep 23 00:35:38 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:38 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2" returned: 0 in 0.406s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ebb31-67f8-4ec5-a641-502fa7aad505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e393d5ca-931b-444d-9733-ab2a778efed2', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04159616-8471-4fec-9b0b-5dcbfc124797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:38 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f" returned: 0 in 0.724s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c005199-a9c8-493c-a4ed-3105853d0658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:38 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Volume volume-e393d5ca-931b-444d-9733-ab2a778efed2 (e393d5ca-931b-444d-9733-ab2a778efed2): created successfully
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04159616-8471-4fec-9b0b-5dcbfc124797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (4bbae384-5645-452f-ad60-b31090d181ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac33f821-ea3e-4088-9138-7c20c8d8168b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:38 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-73b31fa4-a364-4ff2-8fa7-378a70b096ab tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:35:39 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658
Sep 23 00:35:39 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:39 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658" returned: 0 in 0.555s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:39 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f
Sep 23 00:35:39 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:39 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 44bca67c-d6ac-46bb-a02b-2d2aa0205b56 of volume e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7edb01d-03bd-4796-aea5-14c34fa39122]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f" returned: 0 in 0.673s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2
Sep 23 00:35:40 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f
Sep 23 00:35:40 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2" returned: 0 in 0.576s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:40 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658.0411719c-4b56-4998-81f0-62480270ed9f" returned: 0 in 0.481s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:40 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 1G
Sep 23 00:35:40 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0411719c-4b56-4998-81f0-62480270ed9f" released by "_delete_snapshot" :: held 2.616s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" released by "delete_snapshot" :: held 2.665s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Created reservations ['75753345-4336-4a8a-82ee-c2b0a0bd694c', 'c3282239-f518-420f-8126-65d3e16fff70', '02aa68f9-98ff-4e1c-a150-c99b6281b2cc', '54c7c23f-50a8-4534-84dc-276443abca84'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:40 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Delete snapshot completed successfully.
Sep 23 00:35:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-c8356c21-9ebb-4e50-ad5c-75b1bfbd5567 tempest-ProjectReaderTests-355187485 None] Lock "cinder-0411719c-4b56-4998-81f0-62480270ed9f-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-6c005199-a9c8-493c-a4ed-3105853d0658-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "cinder-6c005199-a9c8-493c-a4ed-3105853d0658-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:41 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 1G" returned: 0 in 0.855s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e393d5ca-931b-444d-9733-ab2a778efed2 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" acquired by "delete_volume" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:41 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e393d5ca-931b-444d-9733-ab2a778efed2 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56
Sep 23 00:35:41 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47ec3a0-e0ee-4eac-ba53-8b86d2f090ab]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658
Sep 23 00:35:41 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:41 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e393d5ca-931b-444d-9733-ab2a778efed2 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56" returned: 0 in 0.432s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:41 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 is being set with open permissions: ugo+rw
Sep 23 00:35:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:41 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56
Sep 23 00:35:41 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658" returned: 0 in 0.690s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:42 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658
Sep 23 00:35:42 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56" returned: 0 in 0.573s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:42 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info
Sep 23 00:35:42 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:42 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6c005199-a9c8-493c-a4ed-3105853d0658" returned: 0 in 0.496s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-6c005199-a9c8-493c-a4ed-3105853d0658" released by "delete_volume" :: held 1.310s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Created reservations ['17be1c88-44d3-41aa-a3c5-82c8883304bc', '8493c8c4-5ee9-4532-84e9-e1bef7e97876', '50c3ff8d-4b24-4257-93fe-edb5c26d96db', 'b7036e28-364a-4f9c-8485-f890d0f5d98d'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:42 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:42 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info is being set with open permissions: ugo+rw
Sep 23 00:35:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info
Sep 23 00:35:43 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:43 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:43 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:43 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.info" returned: 0 in 0.405s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.485s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b94537c0-27f6-446d-9a9c-6d66fe893cf0 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:35:43 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.421s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:43 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Deleted volume successfully.
Sep 23 00:35:43 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-97920f24-6281-4977-a98c-68494c42df59 tempest-ProjectReaderTests-355187485 None] Lock "cinder-6c005199-a9c8-493c-a4ed-3105853d0658-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-44bca67c-d6ac-46bb-a02b-2d2aa0205b56-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-44bca67c-d6ac-46bb-a02b-2d2aa0205b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (24f09354-e4ea-4750-90b2-2ea02c69c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c6223c-5017-4d5a-933e-bfc691058981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c6223c-5017-4d5a-933e-bfc691058981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536989848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490cd6d6-14e0-4ebc-9499-05dc19f94c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:44Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0ae1b-b221-402a-b13b-6c0048bef105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0ae1b-b221-402a-b13b-6c0048bef105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a0de0-50f3-4130-861c-04982eadbfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a0de0-50f3-4130-861c-04982eadbfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490cd6d6-14e0-4ebc-9499-05dc19f94c3d', 'volume_name': 'volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72de35-d5f8-4619-ab60-708aea06b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72de35-d5f8-4619-ab60-708aea06b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b215be-66c7-4b7d-a828-e52d576cc54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:44 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Volume 490cd6d6-14e0-4ebc-9499-05dc19f94c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d', 'volume_size': 1}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536989848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490cd6d6-14e0-4ebc-9499-05dc19f94c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:44Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Creating volume 490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:44 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" acquired by "delete_snapshot" :: waited 0.148s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-44bca67c-d6ac-46bb-a02b-2d2aa0205b56" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-44bca67c-d6ac-46bb-a02b-2d2aa0205b56" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:44 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d 1073741824
Sep 23 00:35:44 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 44bca67c-d6ac-46bb-a02b-2d2aa0205b56 of volume e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb1915-a428-4cc0-86b2-5fe407eb6f50]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:44 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56
Sep 23 00:35:44 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56" returned: 0 in 0.544s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e393d5ca-931b-444d-9733-ab2a778efed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d 1073741824" returned: 0 in 0.669s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef269f85-3769-4353-92e3-69599b782e0b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d
Sep 23 00:35:45 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2
Sep 23 00:35:45 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:45 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b215be-66c7-4b7d-a828-e52d576cc54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b571861-f1ba-42c7-b87c-734a18eade36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:45 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Volume volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d (490cd6d6-14e0-4ebc-9499-05dc19f94c3d): created successfully
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b571861-f1ba-42c7-b87c-734a18eade36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (24f09354-e4ea-4750-90b2-2ea02c69c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:45 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-de611c51-71ae-478b-a281-3c812388a428 tempest-ProjectReaderTests-355187485 None] Created volume successfully.
Sep 23 00:35:45 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2" returned: 0 in 0.598s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:45 devstack sudo[107819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56
Sep 23 00:35:45 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56" returned: 0 in 0.519s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56
Sep 23 00:35:46 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:46 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2.44bca67c-d6ac-46bb-a02b-2d2aa0205b56" returned: 0 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-44bca67c-d6ac-46bb-a02b-2d2aa0205b56" released by "_delete_snapshot" :: held 2.259s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" released by "delete_snapshot" :: held 2.300s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Creating offline snapshot b91bd178-e7cb-41c8-aedc-25ea5df9218a of volume 490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8d66a-435c-4e52-9d37-cb7baee1b8c6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:46 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Created reservations ['2e5e1946-7739-449c-a988-1a65a2bdaaf3', '28398847-83cc-4254-bca6-5e5943245249', '3558a762-afb8-4a0d-b51a-9a1ce958d037', '1408d025-38de-4122-b5ed-f41764f87c14'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:47 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d
Sep 23 00:35:47 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:35:47 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-8eab8bd1-cf00-42a9-81b8-565923e7609e tempest-ProjectMemberTests-1829957451 None] Lock "cinder-44bca67c-d6ac-46bb-a02b-2d2aa0205b56-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:47 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" returned: 0 in 0.474s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:47 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a 1G
Sep 23 00:35:47 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-e393d5ca-931b-444d-9733-ab2a778efed2-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-e393d5ca-931b-444d-9733-ab2a778efed2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c01f8-e33f-4a72-ab82-456d374f9cbd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:47 devstack sudo[107840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2
Sep 23 00:35:47 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:47 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a 1G" returned: 0 in 0.665s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a
Sep 23 00:35:48 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:48 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2" returned: 0 in 0.570s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2
Sep 23 00:35:48 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:48 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a" returned: 0 in 0.568s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a is being set with open permissions: ugo+rw
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:48 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a
Sep 23 00:35:48 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:48 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-e393d5ca-931b-444d-9733-ab2a778efed2" returned: 0 in 0.447s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-e393d5ca-931b-444d-9733-ab2a778efed2" released by "delete_volume" :: held 1.133s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:48 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a" returned: 0 in 0.374s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:48 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Created reservations ['a71c6e57-b90b-4a11-9dab-323564b16822', 'ee5bea8d-660d-4d26-8c02-ff4ac00871d5', 'd8db211f-5ce0-4691-b2b7-01aeeb3443c6', 'bb2e5aad-3f7b-4b6e-bf6a-223ecd6808f1'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:49 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info
Sep 23 00:35:49 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:49 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:49 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info" returned: 0 in 0.340s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info is being set with open permissions: ugo+rw
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:49 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info
Sep 23 00:35:49 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.292s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-faf743c8-206c-4927-baee-c3c345d4a98a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-e393d5ca-931b-444d-9733-ab2a778efed2-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:49 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.info" returned: 0 in 0.315s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7b57fd29-9679-4d7b-83db-424c39e73cf9 tempest-ProjectReaderTests-355187485 None] Create snapshot completed successfully
Sep 23 00:35:49 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-b91bd178-e7cb-41c8-aedc-25ea5df9218a-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-b91bd178-e7cb-41c8-aedc-25ea5df9218a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-b91bd178-e7cb-41c8-aedc-25ea5df9218a" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-b91bd178-e7cb-41c8-aedc-25ea5df9218a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Deleting offline snapshot b91bd178-e7cb-41c8-aedc-25ea5df9218a of volume 490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] snapshot_file for this snap is: volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e776d9f-64a4-4996-9edb-83eae04477a1]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a
Sep 23 00:35:50 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (beb135ab-e6f2-4ef0-bc94-580685ef225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d5e157-5886-4799-8241-466b6a37aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a" returned: 0 in 0.582s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d5e157-5886-4799-8241-466b6a37aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169256488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06c87c-a4fa-4e17-8ce6-3068b85b0b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:51Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be16f122-aa5c-4194-b56e-d3b36d43b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be16f122-aa5c-4194-b56e-d3b36d43b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916abfda-e251-4b1d-933b-aec31496167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916abfda-e251-4b1d-933b-aec31496167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab06c87c-a4fa-4e17-8ce6-3068b85b0b93', 'volume_name': 'volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b2903f-2d5d-4f34-bfd2-477a22778059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b2903f-2d5d-4f34-bfd2-477a22778059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c115fc52-f6a0-4df1-862d-99ce703b4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:50 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Volume ab06c87c-a4fa-4e17-8ce6-3068b85b0b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93', 'volume_size': 1}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169256488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06c87c-a4fa-4e17-8ce6-3068b85b0b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:51Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Creating volume ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:35:50 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3696b86-d061-4b38-ba4d-09968764f63b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:50 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:50 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 1073741824
Sep 23 00:35:50 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:50 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d
Sep 23 00:35:50 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:51 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" returned: 0 in 0.661s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:51 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a
Sep 23 00:35:51 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:51 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 1073741824" returned: 0 in 0.840s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:51 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93
Sep 23 00:35:51 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:52 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:52 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a" returned: 0 in 0.590s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c115fc52-f6a0-4df1-862d-99ce703b4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92bdb8f-3237-4550-8c4b-884c08d9ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:35:52 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a
Sep 23 00:35:52 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:52 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Volume volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 (ab06c87c-a4fa-4e17-8ce6-3068b85b0b93): created successfully
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92bdb8f-3237-4550-8c4b-884c08d9ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (beb135ab-e6f2-4ef0-bc94-580685ef225b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:35:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-630c0628-7dcf-422d-a19d-baea4c5851b4 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:35:52 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d.b91bd178-e7cb-41c8-aedc-25ea5df9218a" returned: 0 in 0.351s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-b91bd178-e7cb-41c8-aedc-25ea5df9218a" released by "_delete_snapshot" :: held 2.398s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" released by "delete_snapshot" :: held 2.430s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Created reservations ['63302f2e-c7e7-4cc2-846f-b7c07714335d', '004422e1-9378-4adf-89e6-e0f45aaff436', '8d0678b3-43f2-4b6c-8a47-0c5c5d9bc5f7', '64260a4b-7cc0-4ad7-8a41-4c62333a435e'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:52 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Delete snapshot completed successfully.
Sep 23 00:35:52 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f1439eb4-e2e9-4f20-8e34-731daff4057b tempest-ProjectReaderTests-355187485 None] Lock "cinder-b91bd178-e7cb-41c8-aedc-25ea5df9218a-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 381a16af-c650-4710-b10a-a054618c9826 of volume ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[af156e6a-f8fe-453c-a28e-9ffb212a35f4]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:53 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93
Sep 23 00:35:53 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-490cd6d6-14e0-4ebc-9499-05dc19f94c3d-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "cinder-490cd6d6-14e0-4ebc-9499-05dc19f94c3d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:53 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" returned: 0 in 0.435s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:53 devstack sudo[107938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 1G
Sep 23 00:35:53 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" acquired by "delete_volume" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1149c9bd-626c-4406-84ea-9915c18112fc]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:35:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:53 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d
Sep 23 00:35:53 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 1G" returned: 0 in 0.549s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826
Sep 23 00:35:54 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" returned: 0 in 0.481s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d
Sep 23 00:35:54 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:54 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 is being set with open permissions: ugo+rw
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826
Sep 23 00:35:54 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" returned: 0 in 0.469s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-490cd6d6-14e0-4ebc-9499-05dc19f94c3d" released by "delete_volume" :: held 1.046s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Created reservations ['042e702c-6c25-42b1-8afb-5c5b0a052028', '4c3049ab-9a62-4d70-98a9-fc4cdd3ebeaa', '1b642718-b89c-4fbc-9575-1333e6f9f3df', '46d80439-5670-4b2b-99e5-89d356b1cd53'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:54 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:54 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:54 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826" returned: 0 in 0.423s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:55 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info
Sep 23 00:35:55 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:55 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.333s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:55 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Deleted volume successfully.
Sep 23 00:35:55 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info" returned: 0 in 0.339s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info is being set with open permissions: ugo+rw
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:55 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info
Sep 23 00:35:55 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:55 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.info" returned: 0 in 0.276s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5ef77fc2-546b-4746-a4ee-d2561b5a240c tempest-ProjectReaderTests-355187485 None] Lock "cinder-490cd6d6-14e0-4ebc-9499-05dc19f94c3d-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:35:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-da0829c9-21b1-48a0-b207-76cb3538d6ff tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:35:57 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:35:57 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:35:57 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.260s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:35:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-381a16af-c650-4710-b10a-a054618c9826-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-381a16af-c650-4710-b10a-a054618c9826-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-381a16af-c650-4710-b10a-a054618c9826" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:35:59 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-381a16af-c650-4710-b10a-a054618c9826" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 381a16af-c650-4710-b10a-a054618c9826 of volume ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[34401494-7dca-430f-906b-3791ec76e2b3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826
Sep 23 00:36:00 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (93af686a-bfea-46d1-bab3-13c198a80199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7416ee5b-08b5-4d45-85c1-94dcdf87a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7416ee5b-08b5-4d45-85c1-94dcdf87a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780249637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d45749c-66cd-475b-93bf-728026763e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:00Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66da85-0af4-4aa0-8cc3-6ffa0934cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66da85-0af4-4aa0-8cc3-6ffa0934cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb5a5d7-d9bd-4667-8e14-3d04d1564113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb5a5d7-d9bd-4667-8e14-3d04d1564113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d45749c-66cd-475b-93bf-728026763e1a', 'volume_name': 'volume-0d45749c-66cd-475b-93bf-728026763e1a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:00 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eace583-6d88-420e-9950-e2477f7fa84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eace583-6d88-420e-9950-e2477f7fa84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0addaf31-a88b-4571-b6fc-d517971a365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:00 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Volume 0d45749c-66cd-475b-93bf-728026763e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d45749c-66cd-475b-93bf-728026763e1a', 'volume_size': 1}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780249637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d45749c-66cd-475b-93bf-728026763e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28af18e803d0410eb775b896a57b948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:00Z,use_quota=True,user_id='11576e09b8f040388ee4d9dada33f958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Creating volume 0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:00 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826" returned: 0 in 0.507s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:00 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a 1073741824
Sep 23 00:36:00 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad708769-7c13-4aa4-b6d5-e278d9d2c683]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:00 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:00 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93
Sep 23 00:36:00 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:01 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a 1073741824" returned: 0 in 0.605s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack sudo[107991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826
Sep 23 00:36:01 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:01 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a
Sep 23 00:36:01 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a" returned: 0 in 0.300s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:01 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826" returned: 0 in 0.399s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0addaf31-a88b-4571-b6fc-d517971a365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d45749c-66cd-475b-93bf-728026763e1a', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717cf97f-b065-43da-bc59-ffc8aa2e0375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:01 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826
Sep 23 00:36:01 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Volume volume-0d45749c-66cd-475b-93bf-728026763e1a (0d45749c-66cd-475b-93bf-728026763e1a): created successfully
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717cf97f-b065-43da-bc59-ffc8aa2e0375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Flow 'volume_create_manager' (93af686a-bfea-46d1-bab3-13c198a80199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:01 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-2abba218-4e07-41df-8fc6-c67085f9b0ad tempest-ProjectReaderTests-355187485 None] Created volume successfully.
Sep 23 00:36:01 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93.381a16af-c650-4710-b10a-a054618c9826" returned: 0 in 0.317s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-381a16af-c650-4710-b10a-a054618c9826" released by "_delete_snapshot" :: held 1.900s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" released by "delete_snapshot" :: held 1.945s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=215,cinder:SELECT=169,cinder:INSERT=63,cinder:DELETE=20 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Created reservations ['17448511-0273-49b4-8b2f-7b27b5bf680f', '7652f0fe-6dc4-4198-8e7d-8743bfaddacc', '09a0f52b-26b1-469c-9ec8-ce2ee8629feb', 'b912efe6-f3e0-4bc4-99d3-dc93d131cdf0'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:01 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=169,cinder:UPDATE=231,cinder:DELETE=17,cinder:INSERT=57 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:36:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7df62424-67d1-4a81-9184-a4f1af2bde78 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-381a16af-c650-4710-b10a-a054618c9826-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "cinder-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846675d-e6a3-4a76-94a8-f4bc326e6861]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:02 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93
Sep 23 00:36:02 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Creating offline snapshot 954d058c-5914-46d8-b026-7d3c88050121 of volume 0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:02 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" returned: 0 in 0.584s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[45574809-6860-4d87-9f4e-1fb97c317733]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:02 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93
Sep 23 00:36:02 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:03 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a
Sep 23 00:36:03 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:03 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" returned: 0 in 0.387s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93" released by "delete_volume" :: held 1.072s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Created reservations ['beb2e556-62ee-4cee-b6d0-e9cf648b2055', '91534669-632e-4498-9d06-794d74e253ca', 'e02a0c72-9308-4de8-a33c-4ba303aca15d', 'a05ec418-f5b3-419c-bccc-d16176da8d61'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:03 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a" returned: 0 in 0.554s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:03 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 1G
Sep 23 00:36:03 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:03 devstack sudo[108019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:03 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:03 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.356s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:03 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:03 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-be69cf15-c5e6-487f-848c-9fcd6b34ed6b tempest-ProjectMemberTests-1829957451 None] Lock "cinder-ab06c87c-a4fa-4e17-8ce6-3068b85b0b93-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Flow 'volume_create_manager' (b3301ce6-1261-4a47-8dcd-a17308da84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0706e5ba-57e0-4ae1-8577-e6cff1c9b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0706e5ba-57e0-4ae1-8577-e6cff1c9b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-864993071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a367d90-ec6d-4f50-ab9d-3c6543e070ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8e563fa40c4d2487372a070b415156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:04Z,use_quota=True,user_id='6025804889844595b137e926589c0cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2548be-a1be-4806-86bb-08a548649bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2548be-a1be-4806-86bb-08a548649bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d5693-2b7d-438f-8bb9-a6875dbbcda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520d5693-2b7d-438f-8bb9-a6875dbbcda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a367d90-ec6d-4f50-ab9d-3c6543e070ad', 'volume_name': 'volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7c8ce-1180-462a-a31b-aa09ae07424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7c8ce-1180-462a-a31b-aa09ae07424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54df3dd-23f7-4d44-864d-1a971234794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:04 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Volume 1a367d90-ec6d-4f50-ab9d-3c6543e070ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad', 'volume_size': 1}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 1G" returned: 0 in 0.670s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d45749c-66cd-475b-93bf-728026763e1a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:04 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d45749c-66cd-475b-93bf-728026763e1a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121
Sep 23 00:36:04 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:04 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d45749c-66cd-475b-93bf-728026763e1a -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121" returned: 0 in 0.338s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:04 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 is being set with open permissions: ugo+rw
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:04 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121
Sep 23 00:36:04 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:04 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:04 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info
Sep 23 00:36:04 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (d0f06dad-35df-4fa6-b979-df4f9c4b59bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64b2e0-f36d-45c9-98bc-9a78a677d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64b2e0-f36d-45c9-98bc-9a78a677d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517622506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443b1df9-4a6b-41b6-a26a-0943d30aac8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:05Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4edf74-c67e-4e6e-b8c3-7837f4e0baf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4edf74-c67e-4e6e-b8c3-7837f4e0baf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03bc517-c809-466b-8d98-3902dfb1cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03bc517-c809-466b-8d98-3902dfb1cb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443b1df9-4a6b-41b6-a26a-0943d30aac8d', 'volume_name': 'volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe780d-64b8-4450-b06e-1556e616d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe780d-64b8-4450-b06e-1556e616d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f88002c-285e-400d-99cf-aa260f5a3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Volume 443b1df9-4a6b-41b6-a26a-0943d30aac8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d', 'volume_size': 1}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:05 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info" returned: 0 in 0.326s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:05 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info is being set with open permissions: ugo+rw
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:05 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info
Sep 23 00:36:05 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:05 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.info" returned: 0 in 0.283s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-864993071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a367d90-ec6d-4f50-ab9d-3c6543e070ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8e563fa40c4d2487372a070b415156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:04Z,use_quota=True,user_id='6025804889844595b137e926589c0cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Creating volume 1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:05 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:05 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad 1073741824
Sep 23 00:36:05 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-48051d77-6da3-4fb0-a669-cc440821070a tempest-ProjectReaderTests-355187485 None] Create snapshot completed successfully
Sep 23 00:36:05 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad 1073741824" returned: 0 in 0.464s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:05 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:05 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-954d058c-5914-46d8-b026-7d3c88050121-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-954d058c-5914-46d8-b026-7d3c88050121-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-954d058c-5914-46d8-b026-7d3c88050121" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-954d058c-5914-46d8-b026-7d3c88050121" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Deleting offline snapshot 954d058c-5914-46d8-b026-7d3c88050121 of volume 0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] snapshot_file for this snap is: volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1790d4-e8c7-41bb-81aa-7d2221768da0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121
Sep 23 00:36:06 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:06 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.348s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517622506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443b1df9-4a6b-41b6-a26a-0943d30aac8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:05Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Creating volume 443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:06 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54df3dd-23f7-4d44-864d-1a971234794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:06 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d 1073741824
Sep 23 00:36:06 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04727fb-114f-4192-a14d-4cfb051a4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Volume volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad (1a367d90-ec6d-4f50-ab9d-3c6543e070ad): created successfully
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04727fb-114f-4192-a14d-4cfb051a4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Flow 'volume_create_manager' (b3301ce6-1261-4a47-8dcd-a17308da84e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-31d7fa61-7457-41f2-b5f3-20ad3d12ec44 tempest-SnapshotDependencyTests-1697058778 None] Created volume successfully.
Sep 23 00:36:06 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d45749c-66cd-475b-93bf-728026763e1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc25c3-76c0-4b53-a453-e277492ec313]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a
Sep 23 00:36:06 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:06 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d 1073741824" returned: 0 in 0.497s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:06 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d
Sep 23 00:36:06 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a" returned: 0 in 0.443s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121
Sep 23 00:36:07 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d" returned: 0 in 0.341s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f88002c-285e-400d-99cf-aa260f5a3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361aa4fd-0d37-49d6-a001-3f57768a3923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:07 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Volume volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d (443b1df9-4a6b-41b6-a26a-0943d30aac8d): created successfully
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361aa4fd-0d37-49d6-a001-3f57768a3923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (d0f06dad-35df-4fa6-b979-df4f9c4b59bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:07 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-83dd74bc-9b4a-4a7b-a240-6396506101df tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:36:07 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121" returned: 0 in 0.430s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121
Sep 23 00:36:07 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Creating offline snapshot faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 of volume 1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2f115-5c8c-4348-90f8-ad1fd63928ee]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:07 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:07 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:07 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a.954d058c-5914-46d8-b026-7d3c88050121" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-954d058c-5914-46d8-b026-7d3c88050121" released by "_delete_snapshot" :: held 1.803s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:07 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" released by "delete_snapshot" :: held 1.832s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Created reservations ['f00b7f33-4f5e-4204-9c13-aa9b94d5eb98', '9111716d-b33c-404f-9975-27fad4022351', '3920d9a4-d4c7-49e8-8fcf-2747111d33d2', '5a21d6c9-eb62-4e4d-8a90-dd14be834c59'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:08 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Delete snapshot completed successfully.
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-72f1c5b5-2fc2-4965-8916-ee5631e10bc0 tempest-ProjectReaderTests-355187485 None] Lock "cinder-954d058c-5914-46d8-b026-7d3c88050121-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:08 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.498s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:08 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 1G
Sep 23 00:36:08 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-0d45749c-66cd-475b-93bf-728026763e1a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "cinder-0d45749c-66cd-475b-93bf-728026763e1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Acquiring lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" acquired by "delete_volume" :: waited 0.035s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0520b015-9f0f-47fe-a349-38b491e95ea0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:08 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a
Sep 23 00:36:08 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:08 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 1G" returned: 0 in 0.579s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:08 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:08 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:08 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a" returned: 0 in 0.456s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:08 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a
Sep 23 00:36:08 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 is being set with open permissions: ugo+rw
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:09 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:09 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-0d45749c-66cd-475b-93bf-728026763e1a" returned: 0 in 0.325s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "cinder-quobyte-0d45749c-66cd-475b-93bf-728026763e1a" released by "delete_volume" :: held 0.888s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Created reservations ['23dcbaf7-1554-46fb-b409-0821d9338580', 'c821b220-195b-43dc-9082-a470fcda6614', 'e518f961-b8ea-4656-bf70-8a86a01312a5', '3c0590a8-307b-479d-89d0-1121909c8e99'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:09 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.334s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:09 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info
Sep 23 00:36:09 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:09 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info" returned: 0 in 0.322s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info is being set with open permissions: ugo+rw
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:09 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.314s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Deleted volume successfully.
Sep 23 00:36:09 devstack sudo[108112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info
Sep 23 00:36:09 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-b05320b3-ca04-409b-9d13-55e58cffe3d8 tempest-ProjectReaderTests-355187485 None] Lock "cinder-0d45749c-66cd-475b-93bf-728026763e1a-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:10 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.info" returned: 0 in 0.310s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.666s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 170b19b9-ea9f-4f98-958f-cac7ae11b883 of volume 443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:10 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f7e91107-74f5-4242-8bf7-7c2b990d3b1e tempest-SnapshotDependencyTests-1697058778 None] Create snapshot completed successfully
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c72748-98ac-4905-8b82-afc37094802c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:10 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d
Sep 23 00:36:10 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:10 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d" returned: 0 in 0.449s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:10 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:10 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 1G
Sep 23 00:36:10 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:11 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 1G" returned: 0 in 0.572s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:11 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883
Sep 23 00:36:11 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:11 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883" returned: 0 in 0.473s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:11 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 is being set with open permissions: ugo+rw
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:11 devstack sudo[108131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883
Sep 23 00:36:11 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Flow 'volume_create_manager' (5795d361-e647-4381-972c-dfaf89baea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ba381-43ae-4276-b2b6-ea2b16954438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ba381-43ae-4276-b2b6-ea2b16954438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b282060-b49c-4529-bae8-6878f1482e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8e563fa40c4d2487372a070b415156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=faa6aaf0-7ae9-459b-8308-5fbce34c4ed0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:12Z,use_quota=True,user_id='6025804889844595b137e926589c0cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06975759-5419-43ec-ab8f-cbcfafce8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06975759-5419-43ec-ab8f-cbcfafce8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81fda04-5b9c-4178-b1fe-f3b79f14af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81fda04-5b9c-4178-b1fe-f3b79f14af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b282060-b49c-4529-bae8-6878f1482e7a', 'volume_name': 'volume-8b282060-b49c-4529-bae8-6878f1482e7a', 'volume_size': 1, 'snapshot_id': 'faa6aaf0-7ae9-459b-8308-5fbce34c4ed0'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a17e95a-af8a-4a09-9d4d-3492c24ab577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a17e95a-af8a-4a09-9d4d-3492c24ab577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858cf88-3b9b-40d6-a666-590a71109877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:11 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Volume 8b282060-b49c-4529-bae8-6878f1482e7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b282060-b49c-4529-bae8-6878f1482e7a', 'volume_size': 1, 'snapshot_id': 'faa6aaf0-7ae9-459b-8308-5fbce34c4ed0'}
Sep 23 00:36:11 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:12 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883" returned: 0 in 0.306s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:12 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info
Sep 23 00:36:12 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:12 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info" returned: 0 in 0.326s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:12 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info is being set with open permissions: ugo+rw
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:12 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info
Sep 23 00:36:12 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:12 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.info" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.776s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-8b282060-b49c-4529-bae8-6878f1482e7a" by "_create_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-8b282060-b49c-4529-bae8-6878f1482e7a" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Creating volume 8b282060-b49c-4529-bae8-6878f1482e7a from snapshot faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" by "_copy_volume_from_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] snapshot: faa6aaf0-7ae9-459b-8308-5fbce34c4ed0, volume: 8b282060-b49c-4529-bae8-6878f1482e7a,  {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 23 00:36:12 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-af083578-4534-4541-a602-00eaaca145af tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e353a1-50fb-4e15-a859-f85c0cd68224]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:12 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:12 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:12 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:13 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.484s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ebc4d-c73e-4e24-ab77-c698cc7cc041]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:13 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:13 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-170b19b9-ea9f-4f98-958f-cac7ae11b883-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:13 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.511s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Creating direct copy from snapshot {{(pid=86631) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.utils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Path /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a not found in is_blk_device check {{(pid=86631) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-170b19b9-ea9f-4f98-958f-cac7ae11b883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:13 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a
Sep 23 00:36:13 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-170b19b9-ea9f-4f98-958f-cac7ae11b883" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-170b19b9-ea9f-4f98-958f-cac7ae11b883" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 170b19b9-ea9f-4f98-958f-cac7ae11b883 of volume 443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:13 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[323ed3e9-092d-49af-a93e-52f0c45faaed]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:14 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883
Sep 23 00:36:14 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:14 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883" returned: 0 in 0.537s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:14 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:14 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e81cdb3-fb5e-4f03-a507-ec1391ea6655]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:14 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:14 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d
Sep 23 00:36:14 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:15 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d" returned: 0 in 0.920s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:15 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:15 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883
Sep 23 00:36:15 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:16 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883" returned: 0 in 0.860s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:16 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883
Sep 23 00:36:16 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:16 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:16 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d.170b19b9-ea9f-4f98-958f-cac7ae11b883" returned: 0 in 0.495s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:16 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-170b19b9-ea9f-4f98-958f-cac7ae11b883" released by "_delete_snapshot" :: held 3.021s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" released by "delete_snapshot" :: held 3.063s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:17 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Created reservations ['33c50b1e-431a-40e4-a56c-7205d697bf5f', '3874ac34-fd9f-46b9-b33f-8846703fceb8', '0e6648fe-ac79-4caa-b7c2-bbd3095a6d4b', '85f9a2f4-4e8d-4a99-a917-e30588e00ca0'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:17 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:17 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-f5155585-5d08-4ef8-bd57-ab2bcca2a3cc tempest-ProjectMemberTests-1829957451 None] Lock "cinder-170b19b9-ea9f-4f98-958f-cac7ae11b883-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-443b1df9-4a6b-41b6-a26a-0943d30aac8d-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "cinder-443b1df9-4a6b-41b6-a26a-0943d30aac8d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" acquired by "delete_volume" :: waited 0.041s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8428e0-39a9-4751-b651-5ce2bc377eb0]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:18 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:18 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d
Sep 23 00:36:18 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:19 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d" returned: 0 in 0.602s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:19 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:19 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d
Sep 23 00:36:19 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:20 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-443b1df9-4a6b-41b6-a26a-0943d30aac8d" returned: 0 in 0.956s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-443b1df9-4a6b-41b6-a26a-0943d30aac8d" released by "delete_volume" :: held 1.737s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Created reservations ['4a98f6c5-4948-476e-be00-87c8bc80e64f', 'c6b5e4bb-00b4-4cb9-84f4-f5d38db18ce6', '0742a40b-bdae-417b-9832-3e5e2c9d3856', '043818e2-1d0a-44c0-818c-2edaf80ad140'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:20 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:20 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:20 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:21 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:21 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.579s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:21 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:21 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:21 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-774f9d57-4be5-4dc4-ba13-8d3d85e2d12d tempest-ProjectMemberTests-1829957451 None] Lock "cinder-443b1df9-4a6b-41b6-a26a-0943d30aac8d-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:21 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (be2c9e80-672b-4cfe-828d-3d189195295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2377cf4-2ede-4aa9-8683-9160e2edb14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2377cf4-2ede-4aa9-8683-9160e2edb14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015109395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55db4c61-632e-462d-b06b-1b2306438961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55db4c61-632e-462d-b06b-1b2306438961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1efef7-d66f-4193-abef-a2517ec7c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1efef7-d66f-4193-abef-a2517ec7c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259', 'volume_name': 'volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4436d1-a556-4de1-ab8f-96095a0d630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4436d1-a556-4de1-ab8f-96095a0d630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6576da-c86b-4c5a-85d3-8e3be73eb642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Volume 6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259', 'volume_size': 1}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:22 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a" returned: 0 in 8.586s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.image.image_utils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Image conversion details: src /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a {{(pid=86631) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 23 00:36:22 devstack cinder-volume[86631]: INFO cinder.image.image_utils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Converted 1024.00 MB image at 119.26 MB/s
Sep 23 00:36:22 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a is being set with open permissions: ugo+rw
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:22 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a
Sep 23 00:36:22 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:22 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a" returned: 0 in 0.270s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-8b282060-b49c-4529-bae8-6878f1482e7a" released by "_create_volume_from_snapshot" :: held 10.055s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.082s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015109395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Creating volume 6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:22 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:22 devstack sudo[108197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 1073741824
Sep 23 00:36:22 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858cf88-3b9b-40d6-a666-590a71109877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b282060-b49c-4529-bae8-6878f1482e7a', 'volume_size': 1, 'snapshot_id': 'faa6aaf0-7ae9-459b-8308-5fbce34c4ed0'}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447bd921-81a3-46e0-af15-ccb8cac60206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:22 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Volume volume-8b282060-b49c-4529-bae8-6878f1482e7a (8b282060-b49c-4529-bae8-6878f1482e7a): created successfully
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447bd921-81a3-46e0-af15-ccb8cac60206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:22 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Flow 'volume_create_manager' (5795d361-e647-4381-972c-dfaf89baea40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:22 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-49aaf012-9488-4ef0-b87b-0210d39fdf1d tempest-SnapshotDependencyTests-1697058778 None] Created volume successfully.
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Deleting offline snapshot faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 of volume 1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] snapshot_file for this snap is: volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdab822-e8ec-4dbe-94af-1a25fc8ec402]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 1073741824" returned: 0 in 0.649s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:23 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:23 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259
Sep 23 00:36:23 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:23 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.459s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:23 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6576da-c86b-4c5a-85d3-8e3be73eb642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf008eda-2f0c-4b7e-933f-63d7403588f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0a9ed-4e97-4577-bb3a-f3669402087f]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:23 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Volume volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 (6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259): created successfully
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf008eda-2f0c-4b7e-933f-63d7403588f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:23 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (be2c9e80-672b-4cfe-828d-3d189195295f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:23 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-914127ea-9ac7-46fa-bfb0-b4ee02d37165 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:36:24 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:24 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.567s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:24 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:24 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:24 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.344s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:24 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:24 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0
Sep 23 00:36:24 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad.faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" returned: 0 in 0.290s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0" released by "_delete_snapshot" :: held 1.837s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" released by "delete_snapshot" :: held 1.872s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Created reservations ['ef28cc1a-b4aa-453b-881a-fffc0c1bad41', '2cbe469f-0de5-4176-a7e3-9b28ec3df9f7', 'c36d67e1-c751-42fb-84ce-4d2924a84b8f', '1e5db452-0445-4eb1-99de-e22b85a158bf'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 5ca70c57-b5d2-44dd-959e-75fdb3eb74ad of volume 6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e32635-bdca-47a6-b30f-3e33f47f0dcd]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Delete snapshot completed successfully.
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-87baaed1-9698-452d-8ee2-7dac3426fdc7 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-faa6aaf0-7ae9-459b-8308-5fbce34c4ed0-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:25 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259
Sep 23 00:36:25 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-1a367d90-ec6d-4f50-ab9d-3c6543e070ad-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-1a367d90-ec6d-4f50-ab9d-3c6543e070ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" acquired by "delete_volume" :: waited 0.024s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713f2bc-70f7-4fc3-b994-47926746365a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:25 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" returned: 0 in 0.428s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:25 devstack sudo[108233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad 1G
Sep 23 00:36:25 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:25 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:25 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.404s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad
Sep 23 00:36:26 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad 1G" returned: 0 in 0.441s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad
Sep 23 00:36:26 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" returned: 0 in 0.277s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-1a367d90-ec6d-4f50-ab9d-3c6543e070ad" released by "delete_volume" :: held 0.764s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Created reservations ['39e96fb8-6b73-4e87-89ce-57892fb1a6df', '9e0983b5-edfe-481a-a358-16be92a0dfcf', 'a141a8b3-933c-47e5-b7e3-49f8ea6c19ea', '5d1d3481-2648-4420-88fc-a1b981c0785c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:26 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" returned: 0 in 0.327s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad is being set with open permissions: ugo+rw
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad
Sep 23 00:36:26 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-8b282060-b49c-4529-bae8-6878f1482e7a-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-8b282060-b49c-4529-bae8-6878f1482e7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:26 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.309s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" acquired by "delete_volume" :: waited 0.028s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:26 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Deleted volume successfully.
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7471b965-7d10-406d-83a5-1abd38f9dc83]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" returned: 0 in 0.304s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-06f95039-4336-489d-a1ea-4d4fb79cca67 tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-1a367d90-ec6d-4f50-ab9d-3c6543e070ad-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:26 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:26 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info
Sep 23 00:36:26 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:26 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a
Sep 23 00:36:26 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:27 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info" returned: 0 in 0.300s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info is being set with open permissions: ugo+rw
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:27 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info
Sep 23 00:36:27 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:27 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a" returned: 0 in 0.435s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:27 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a
Sep 23 00:36:27 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:27 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.info" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a5a4eff4-9d54-421e-ba29-eeaf9ebf2604 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:36:27 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-8b282060-b49c-4529-bae8-6878f1482e7a" returned: 0 in 0.294s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-quobyte-8b282060-b49c-4529-bae8-6878f1482e7a" released by "delete_volume" :: held 0.783s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Created reservations ['caf87892-2ecd-4be8-9cf0-75c3d6c45df9', 'b934f23d-fe0a-48a5-89fa-821da460b98e', '020a4b07-46cb-418e-9b71-eb3e271364a3', '7e280e00-e821-4d25-97af-3bedf0a31c1c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:27 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:27 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:27 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:27 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:27 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Deleted volume successfully.
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-80f25717-cbc3-45ab-a66f-c05f815ea90f tempest-SnapshotDependencyTests-1697058778 None] Lock "cinder-8b282060-b49c-4529-bae8-6878f1482e7a-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 5ca70c57-b5d2-44dd-959e-75fdb3eb74ad of volume 6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80447d-c96a-46db-9ccf-8c95b1c7b6e3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:28 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad
Sep 23 00:36:28 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:28 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" returned: 0 in 0.421s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:28 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eeca0f-783f-4632-8c54-eb3816066d35]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:29 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259
Sep 23 00:36:29 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:29 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:29 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad
Sep 23 00:36:29 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:29 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" returned: 0 in 0.439s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:29 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:29 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad
Sep 23 00:36:29 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:30 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259.5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" returned: 0 in 0.283s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad" released by "_delete_snapshot" :: held 1.664s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" released by "delete_snapshot" :: held 1.701s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Created reservations ['027aeb03-2b12-45c6-8923-67daa5dcd83c', 'b47618a3-ad2c-499c-8239-f81a79372c84', '46637f36-e17d-4aa8-a471-27ac2c545643', '4b1d78ce-7302-4c76-9da1-950f42c18fb9'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:30 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-89592385-1e44-42ea-9b62-eb3a95ab3ea1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-5ca70c57-b5d2-44dd-959e-75fdb3eb74ad-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536b04f-8d32-4563-9a26-125467ea1b47]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:30 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:30 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259
Sep 23 00:36:30 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:31 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" returned: 0 in 0.383s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:31 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259
Sep 23 00:36:31 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:31 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" returned: 0 in 0.263s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259" released by "delete_volume" :: held 0.721s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Created reservations ['a6596c72-69b2-417a-ad9e-aa1c0c4ba7e2', '775e726e-6ddd-4421-a32f-86db0f8ebef8', 'a2fcd8d7-7fd9-4b07-8bf9-86abafe86eb5', '10ddaf2b-8e6c-4c54-97cb-0dd0cbbb8141'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:31 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:31 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:31 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.321s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:31 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:31 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-47235fd6-b1f8-4543-988f-18b678279be1 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-6e7f4ce7-11ff-4f7e-b38c-d79e9f8fe259-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (3419d62b-35ba-4dff-8524-3e1253c3361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af477c6a-2d87-46d3-8ae8-06133d179181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af477c6a-2d87-46d3-8ae8-06133d179181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384188091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65d8c02-3f34-4d22-af21-df1c04f8804e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ff6e5c-3bf8-4b7a-88fd-cf0868812bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ff6e5c-3bf8-4b7a-88fd-cf0868812bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ea1ac1-5d16-4496-be7a-800c732d2181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ea1ac1-5d16-4496-be7a-800c732d2181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65d8c02-3f34-4d22-af21-df1c04f8804e', 'volume_name': 'volume-c65d8c02-3f34-4d22-af21-df1c04f8804e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6955d3-4bef-409a-a3ae-36295b99e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6955d3-4bef-409a-a3ae-36295b99e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8c784d-9008-4b94-8204-c3492a7cc2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:32 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Volume c65d8c02-3f34-4d22-af21-df1c04f8804e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65d8c02-3f34-4d22-af21-df1c04f8804e', 'volume_size': 1}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384188091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65d8c02-3f34-4d22-af21-df1c04f8804e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:32Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Creating volume c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:32 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:32 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e 1073741824
Sep 23 00:36:32 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:32 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:32 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e 1073741824" returned: 0 in 0.497s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:33 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e
Sep 23 00:36:33 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:33 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e" returned: 0 in 0.263s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8c784d-9008-4b94-8204-c3492a7cc2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65d8c02-3f34-4d22-af21-df1c04f8804e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b715cb-39cc-4dbc-b2b3-badce31f728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:33 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Volume volume-c65d8c02-3f34-4d22-af21-df1c04f8804e (c65d8c02-3f34-4d22-af21-df1c04f8804e): created successfully
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b715cb-39cc-4dbc-b2b3-badce31f728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:33 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (3419d62b-35ba-4dff-8524-3e1253c3361b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:33 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-a10f215f-d915-4e5a-a4b4-4c2d0f34fb47 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:36:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:34 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot be168850-8e76-429b-a63d-1eb398f3d4ef of volume c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:34 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[08676606-880b-4012-9a44-6955896152ec]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:34 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:34 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e
Sep 23 00:36:34 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e" returned: 0 in 0.392s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef 1G
Sep 23 00:36:35 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef 1G" returned: 0 in 0.471s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65d8c02-3f34-4d22-af21-df1c04f8804e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65d8c02-3f34-4d22-af21-df1c04f8804e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef
Sep 23 00:36:35 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:35 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65d8c02-3f34-4d22-af21-df1c04f8804e -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef" returned: 0 in 0.291s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:35 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef is being set with open permissions: ugo+rw
Sep 23 00:36:35 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:35 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef
Sep 23 00:36:35 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef" returned: 0 in 0.248s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info
Sep 23 00:36:36 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info" returned: 0 in 0.263s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info is being set with open permissions: ugo+rw
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:36 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info
Sep 23 00:36:36 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:36 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.info" returned: 0 in 0.297s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:36 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:36 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-d6f17bba-7451-4473-b1e1-625b78822bf0 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-be168850-8e76-429b-a63d-1eb398f3d4ef-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-be168850-8e76-429b-a63d-1eb398f3d4ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-be168850-8e76-429b-a63d-1eb398f3d4ef" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-be168850-8e76-429b-a63d-1eb398f3d4ef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot be168850-8e76-429b-a63d-1eb398f3d4ef of volume c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:37 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694896c-8d97-4a55-9d2a-60492aae0576]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:38 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef
Sep 23 00:36:38 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:38 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef" returned: 0 in 0.491s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c65d8c02-3f34-4d22-af21-df1c04f8804e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad646b-73c4-4dee-bae1-5119946078d5]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:38 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e
Sep 23 00:36:38 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:38 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e" returned: 0 in 0.424s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:38 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:39 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef
Sep 23 00:36:39 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:39 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef" returned: 0 in 0.376s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:39 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef
Sep 23 00:36:39 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:39 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e.be168850-8e76-429b-a63d-1eb398f3d4ef" returned: 0 in 0.290s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-be168850-8e76-429b-a63d-1eb398f3d4ef" released by "_delete_snapshot" :: held 1.708s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" released by "delete_snapshot" :: held 1.737s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Created reservations ['c84a3df1-0196-48a2-8ebf-63464198a5ac', '1feceeb1-2293-4117-b68a-5f6dc64c8e89', '54438a45-ffb5-443e-ba3d-159fd7432b6e', '444f43be-fd74-4854-b838-8c0daaf365eb'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:39 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:39 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-60517a26-9b74-4bef-9516-1f607e6287c4 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-be168850-8e76-429b-a63d-1eb398f3d4ef-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-c65d8c02-3f34-4d22-af21-df1c04f8804e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-c65d8c02-3f34-4d22-af21-df1c04f8804e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1490ca-c69d-4291-b5ea-a9ca4194770b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:40 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e
Sep 23 00:36:40 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:40 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e" returned: 0 in 0.345s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:40 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e
Sep 23 00:36:40 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:40 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-c65d8c02-3f34-4d22-af21-df1c04f8804e" returned: 0 in 0.232s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-c65d8c02-3f34-4d22-af21-df1c04f8804e" released by "delete_volume" :: held 0.640s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Created reservations ['b988b566-a7c5-4b61-a7a3-98743dc245a6', 'beb0eb4a-6e52-4f44-930b-2b8e5c099613', '690bff0d-8292-4a3c-b90b-f20d464a9cc0', '3f06d6b5-cd2b-4602-9611-181b95c9ee71'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:40 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:40 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:40 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:41 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.233s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:41 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-14d0993f-ca28-4624-b539-193eee54bcc9 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-c65d8c02-3f34-4d22-af21-df1c04f8804e-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (3e84ee69-57cd-4227-825f-8486f6adf914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268cacf-d7f6-4c25-8c7e-3492d0cca13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268cacf-d7f6-4c25-8c7e-3492d0cca13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729494242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad47e32-75c3-4f10-8e08-22902bfe7204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:42Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92403b2-36fa-427f-ae50-08b49dee9c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92403b2-36fa-427f-ae50-08b49dee9c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e9f638-6e0d-421a-a817-0f687851403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e9f638-6e0d-421a-a817-0f687851403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad47e32-75c3-4f10-8e08-22902bfe7204', 'volume_name': 'volume-5ad47e32-75c3-4f10-8e08-22902bfe7204', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94a36a2-47a6-45d0-9efb-051f938e42eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94a36a2-47a6-45d0-9efb-051f938e42eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166323d-7ee2-4db1-bd06-4deb27ea972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:41 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Volume 5ad47e32-75c3-4f10-8e08-22902bfe7204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad47e32-75c3-4f10-8e08-22902bfe7204', 'volume_size': 1}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729494242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad47e32-75c3-4f10-8e08-22902bfe7204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:42Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Creating volume 5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:41 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:41 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:41 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 1073741824
Sep 23 00:36:41 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:42 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 1073741824" returned: 0 in 0.403s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:42 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204
Sep 23 00:36:42 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:42 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204" returned: 0 in 0.255s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166323d-7ee2-4db1-bd06-4deb27ea972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad47e32-75c3-4f10-8e08-22902bfe7204', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3439e873-cd6e-4243-a297-255d45ce7872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:42 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Volume volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 (5ad47e32-75c3-4f10-8e08-22902bfe7204): created successfully
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3439e873-cd6e-4243-a297-255d45ce7872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (3e84ee69-57cd-4227-825f-8486f6adf914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:42 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-faafca58-08b5-4d9a-bc08-e2c9e4c3c3e2 tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 8c657066-4897-4301-8645-1157a15ee40a of volume 5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3fef97-25d6-4086-a2c4-469277cac47c]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:42 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:42 devstack sudo[108388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204
Sep 23 00:36:42 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:43 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204" returned: 0 in 0.377s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:43 devstack sudo[108393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a 1G
Sep 23 00:36:43 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:43 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a 1G" returned: 0 in 0.406s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:43 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a
Sep 23 00:36:43 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:43 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a" returned: 0 in 0.282s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:43 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a is being set with open permissions: ugo+rw
Sep 23 00:36:43 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:43 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a
Sep 23 00:36:43 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:44 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a" returned: 0 in 0.268s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:44 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info
Sep 23 00:36:44 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:44 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info" returned: 0 in 0.262s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:44 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info is being set with open permissions: ugo+rw
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:44 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info
Sep 23 00:36:44 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:44 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.info" returned: 0 in 0.238s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:44 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-58d4b7f3-9f9c-487e-966e-ebd485df0867 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:36:44 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-8c657066-4897-4301-8645-1157a15ee40a-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-8c657066-4897-4301-8645-1157a15ee40a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-8c657066-4897-4301-8645-1157a15ee40a" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-8c657066-4897-4301-8645-1157a15ee40a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 8c657066-4897-4301-8645-1157a15ee40a of volume 5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[87368c39-8e87-49fd-b235-c742098c7506]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:45 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a
Sep 23 00:36:45 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:45 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a" returned: 0 in 0.350s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad47e32-75c3-4f10-8e08-22902bfe7204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[db605587-a2b8-4b91-a841-b7cec9557cf6]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:45 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204
Sep 23 00:36:45 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:45 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204" returned: 0 in 0.376s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:45 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:45 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a
Sep 23 00:36:45 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:46 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a" returned: 0 in 0.362s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:46 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a
Sep 23 00:36:46 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:46 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204.8c657066-4897-4301-8645-1157a15ee40a" returned: 0 in 0.255s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-8c657066-4897-4301-8645-1157a15ee40a" released by "_delete_snapshot" :: held 1.448s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" released by "delete_snapshot" :: held 1.471s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Created reservations ['b82ac1ad-13a8-4a2d-9f04-4f0b0a6ddfe4', '5b7ac1bd-1a2d-4458-a011-0648286b1b45', 'bc1256c6-0fa4-419e-b4c4-b85e82be443c', '57fd1ac2-d298-4802-af88-8baaba349778'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:46 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:46 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-1604d989-c962-4fa6-b942-2d42af183a73 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-8c657066-4897-4301-8645-1157a15ee40a-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-5ad47e32-75c3-4f10-8e08-22902bfe7204-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-5ad47e32-75c3-4f10-8e08-22902bfe7204-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f6a1bb-a9a2-472e-823b-fe2bcd34a86e]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:47 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204
Sep 23 00:36:47 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:47 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204" returned: 0 in 0.415s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:47 devstack sudo[108437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204
Sep 23 00:36:47 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:47 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-5ad47e32-75c3-4f10-8e08-22902bfe7204" returned: 0 in 0.278s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:47 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-5ad47e32-75c3-4f10-8e08-22902bfe7204" released by "delete_volume" :: held 0.757s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Created reservations ['73094759-b62b-47d2-92e9-0b0af3b35ca5', '8b565d5c-15c5-41a0-a0aa-2dcafa72b0ba', 'fa16c18f-aee8-4878-a296-59204eaa9bd0', '548c58c5-313e-49fd-8400-043efffc62bd'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:48 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:48 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:48 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.297s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:48 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-7cf18f07-98fc-432d-8a25-8348f4dd0a21 tempest-ProjectMemberTests-1829957451 None] Lock "cinder-5ad47e32-75c3-4f10-8e08-22902bfe7204-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (a0dbf6b5-2df8-4166-8135-4b398b9ddbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59359c4a-b65d-43ed-aba2-5e7c5625f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59359c4a-b65d-43ed-aba2-5e7c5625f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148288252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab598185-e066-4dc8-8da4-a111a12b363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:49Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5a982e-7d92-433b-984c-ef1af5c62ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5a982e-7d92-433b-984c-ef1af5c62ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a59ce-f418-4a9f-8acd-d44f828477a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57a59ce-f418-4a9f-8acd-d44f828477a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab598185-e066-4dc8-8da4-a111a12b363c', 'volume_name': 'volume-ab598185-e066-4dc8-8da4-a111a12b363c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b5465-aaca-4bda-a1c3-afcb5d5ac0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b5465-aaca-4bda-a1c3-afcb5d5ac0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0b700-e705-492a-8798-229223040b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:48 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Volume ab598185-e066-4dc8-8da4-a111a12b363c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab598185-e066-4dc8-8da4-a111a12b363c', 'volume_size': 1}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148288252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab598185-e066-4dc8-8da4-a111a12b363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f9d87495c54dbc9af84ceab4e57c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:49Z,use_quota=True,user_id='2a428655cb104b918ce4eb8b427af889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Creating volume ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:36:48 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:36:48 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:48 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c 1073741824
Sep 23 00:36:48 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:49 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c 1073741824" returned: 0 in 0.486s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:49 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c
Sep 23 00:36:49 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:49 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c" returned: 0 in 0.279s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0b700-e705-492a-8798-229223040b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab598185-e066-4dc8-8da4-a111a12b363c', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aac8e4-f663-452f-95c3-29d0bf706bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:36:49 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Volume volume-ab598185-e066-4dc8-8da4-a111a12b363c (ab598185-e066-4dc8-8da4-a111a12b363c): created successfully
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aac8e4-f663-452f-95c3-29d0bf706bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:36:49 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Flow 'volume_create_manager' (a0dbf6b5-2df8-4166-8135-4b398b9ddbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:36:49 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-37afba38-4ebe-47b8-8924-3fae271f768e tempest-ProjectMemberTests-1829957451 None] Created volume successfully.
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Creating offline snapshot 25315494-8992-4174-9856-55540debdbe2 of volume ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d88cf-6268-4a46-b164-1fd419cb1bf3]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:51 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c
Sep 23 00:36:51 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:51 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c" returned: 0 in 0.385s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 1G {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:51 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 1G
Sep 23 00:36:51 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:51 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 1G" returned: 0 in 0.414s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:51 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab598185-e066-4dc8-8da4-a111a12b363c -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:51 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab598185-e066-4dc8-8da4-a111a12b363c -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2
Sep 23 00:36:51 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:52 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab598185-e066-4dc8-8da4-a111a12b363c -F qcow2 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2" returned: 0 in 0.357s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:52 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 is being set with open permissions: ugo+rw
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:52 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2
Sep 23 00:36:52 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:52 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2" returned: 0 in 0.260s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:52 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info
Sep 23 00:36:52 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:52 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info" returned: 0 in 0.267s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:52 devstack cinder-volume[86631]: WARNING cinder.volume.drivers.remotefs [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info is being set with open permissions: ugo+rw
Sep 23 00:36:52 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:52 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info
Sep 23 00:36:52 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:53 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.info" returned: 0 in 0.258s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:53 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:53 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-6b6c3b27-29fb-452c-a38e-1e9a4f02a9b8 tempest-ProjectMemberTests-1829957451 None] Create snapshot completed successfully
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-25315494-8992-4174-9856-55540debdbe2-delete_snapshot" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-25315494-8992-4174-9856-55540debdbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" by "delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-25315494-8992-4174-9856-55540debdbe2" by "_delete_snapshot" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-25315494-8992-4174-9856-55540debdbe2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Deleting offline snapshot 25315494-8992-4174-9856-55540debdbe2 of volume ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] snapshot_file for this snap is: volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9a0f4-fb51-4d84-8783-399aa13c9b2a]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:54 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2
Sep 23 00:36:54 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:54 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2" returned: 0 in 0.411s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab598185-e066-4dc8-8da4-a111a12b363c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86631) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194dcdf-b9b2-4c34-910e-7aa988628881]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:54 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:55 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c
Sep 23 00:36:55 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:55 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c" returned: 0 in 0.398s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:55 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2
Sep 23 00:36:55 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:55 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2" returned: 0 in 0.367s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:55 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2
Sep 23 00:36:55 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:55 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c.25315494-8992-4174-9856-55540debdbe2" returned: 0 in 0.282s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:55 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-25315494-8992-4174-9856-55540debdbe2" released by "_delete_snapshot" :: held 1.567s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" released by "delete_snapshot" :: held 1.593s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Created reservations ['6830dbb3-d9e6-4f63-a7f3-9875ee963680', '0078d271-0319-4986-90c2-408128c59b58', '0fb5c1af-72fb-4e73-b4d3-69f4511a833a', 'c8ac40e2-ee47-44de-a64a-3f647777bb07'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:56 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Delete snapshot completed successfully.
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-db952573-220e-4f67-bee2-9feca7b61a0a tempest-ProjectMemberTests-1829957451 None] Lock "cinder-25315494-8992-4174-9856-55540debdbe2-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-ab598185-e066-4dc8-8da4-a111a12b363c-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "cinder-ab598185-e066-4dc8-8da4-a111a12b363c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Acquiring lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" acquired by "delete_volume" :: waited 0.018s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[01169b93-2c31-4257-97ad-7ce03caaf89b]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:36:56 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:56 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c
Sep 23 00:36:56 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:57 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:57 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:57 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c" returned: 0 in 0.433s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:57 devstack sudo[108540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c
Sep 23 00:36:57 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:57 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.337s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_service.periodic_task [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] Running periodic task VolumeManager._thread_info {{(pid=86631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread count: 29 {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-e33c194a-db35-4b93-8425-bfb9619b04fe None None] thread info: [<_MainThread(MainThread, started 132319281332352)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132319167550400)>, <Thread(Thread-3 (stat_writer), started daemon 132319166441792)>, <Thread(Rabbit-heartbeat, started daemon 132319168118208)>, <Thread(Thread-5 (_runner), started daemon 132319165283200)>, <Thread(Thread-7 (_runner), started daemon 132319165327936)>, <Thread(fd_logger, started daemon 132319163007936)>, <Thread(privsep_reader, started daemon 132319162349440)>, <Thread(tpool_thread_0, started daemon 132319154284224)>, <Thread(tpool_thread_1, started daemon 132319145891520)>, <Thread(tpool_thread_2, started daemon 132319137482432)>, <Thread(tpool_thread_3, started daemon 132319129073344)>, <Thread(tpool_thread_4, started daemon 132319120664256)>, <Thread(tpool_thread_5, started daemon 132319112255168)>, <Thread(tpool_thread_6, started daemon 132319103846080)>, <Thread(tpool_thread_7, started daemon 132319095436992)>, <Thread(tpool_thread_8, started daemon 132319087027904)>, <Thread(tpool_thread_9, started daemon 132319078618816)>, <Thread(tpool_thread_10, started daemon 132319070209728)>, <Thread(tpool_thread_11, started daemon 132319061800640)>, <Thread(tpool_thread_12, started daemon 132319053391552)>, <Thread(tpool_thread_13, started daemon 132319044982464)>, <Thread(tpool_thread_14, started daemon 132319036573376)>, <Thread(tpool_thread_15, started daemon 132319028164288)>, <Thread(tpool_thread_16, started daemon 132319019755200)>, <Thread(tpool_thread_17, started daemon 132319011346112)>, <Thread(tpool_thread_18, started daemon 132319002937024)>, <Thread(tpool_thread_19, started daemon 132318994527936)>, <Thread(Rabbit-heartbeat, started daemon 132319164170816)>] {{(pid=86631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 23 00:36:57 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-ab598185-e066-4dc8-8da4-a111a12b363c" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "cinder-quobyte-ab598185-e066-4dc8-8da4-a111a12b363c" released by "delete_volume" :: held 0.794s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Created reservations ['f7ee4143-9487-4771-a78a-243694254a67', '852c5597-44a1-42e4-81ac-7c5471c5732b', '6c8ff899-84bc-4015-a0a3-99d59a8c39be', '8852b6df-932a-4dcc-ad8b-75d6234b6a2b'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:36:57 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:36:57 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:36:57 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.273s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:36:57 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Deleted volume successfully.
Sep 23 00:36:57 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-40322fb9-2909-4a00-8ab4-435406bd0b1c tempest-ProjectMemberTests-1829957451 None] Lock "cinder-ab598185-e066-4dc8-8da4-a111a12b363c-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Flow 'volume_create_manager' (4b36d6b9-c8e9-4fd2-8fcb-ce025f578968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d4c864-9268-45e4-8a65-bfbf8a36d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d4c864-9268-45e4-8a65-bfbf8a36d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843056713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb412f0d-c181-4381-842c-c80afb13db57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a1029f6d6842cf873b7c7c4cb41c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:02Z,use_quota=True,user_id='7b97211c8beb4b99968b2eb22a86da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e00a5-07ce-4538-9a47-145ae194d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e00a5-07ce-4538-9a47-145ae194d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6210a416-0b0f-49f5-8103-9675798eede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6210a416-0b0f-49f5-8103-9675798eede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb412f0d-c181-4381-842c-c80afb13db57', 'volume_name': 'volume-bb412f0d-c181-4381-842c-c80afb13db57', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a01fd7-b4f5-4a19-adc6-cddc0e754f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a01fd7-b4f5-4a19-adc6-cddc0e754f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f535063-3348-427b-92cf-665faf3313bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:01 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Volume bb412f0d-c181-4381-842c-c80afb13db57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb412f0d-c181-4381-842c-c80afb13db57', 'volume_size': 1}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843056713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb412f0d-c181-4381-842c-c80afb13db57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a1029f6d6842cf873b7c7c4cb41c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:02Z,use_quota=True,user_id='7b97211c8beb4b99968b2eb22a86da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Creating volume bb412f0d-c181-4381-842c-c80afb13db57 {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:01 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:37:02 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:02 devstack sudo[108548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 1073741824
Sep 23 00:37:02 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:02 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 1073741824" returned: 0 in 0.472s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:INSERT=39,cinder:UPDATE=144,cinder:SELECT=114,cinder:DELETE=11 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=152,cinder:SELECT=115,cinder:INSERT=41,cinder:DELETE=12 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:02 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57
Sep 23 00:37:02 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:02 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57" returned: 0 in 0.274s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f535063-3348-427b-92cf-665faf3313bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb412f0d-c181-4381-842c-c80afb13db57', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69dfa41-54c7-4d69-b18f-cb98d623e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:02 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Volume volume-bb412f0d-c181-4381-842c-c80afb13db57 (bb412f0d-c181-4381-842c-c80afb13db57): created successfully
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69dfa41-54c7-4d69-b18f-cb98d623e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:02 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Flow 'volume_create_manager' (4b36d6b9-c8e9-4fd2-8fcb-ce025f578968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:37:02 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-4166f81b-c5cf-4ca8-88e8-cfacfc66702e tempest-ProjectReaderTests-1144496402 None] Created volume successfully.
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Acquiring lock "cinder-bb412f0d-c181-4381-842c-c80afb13db57-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "cinder-bb412f0d-c181-4381-842c-c80afb13db57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Acquiring lock "cinder-quobyte-bb412f0d-c181-4381-842c-c80afb13db57" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "cinder-quobyte-bb412f0d-c181-4381-842c-c80afb13db57" acquired by "delete_volume" :: waited 0.016s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7396f83-5616-402a-b6a9-a3db8f220b31]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:04 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57
Sep 23 00:37:04 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:04 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57" returned: 0 in 0.414s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:04 devstack sudo[108561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57
Sep 23 00:37:04 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:04 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:04 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-bb412f0d-c181-4381-842c-c80afb13db57" returned: 0 in 0.277s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "cinder-quobyte-bb412f0d-c181-4381-842c-c80afb13db57" released by "delete_volume" :: held 0.738s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Created reservations ['ad257ea2-844f-41ea-9611-f576061861d1', 'd0cc4307-b02c-473b-a7ca-23bcac9b39d7', '4988f848-88e7-4843-990a-f131b66648fa', '66768566-35f3-448f-acb0-ead597ba72ca'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:05 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:37:05 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:05 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.279s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:37:05 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Deleted volume successfully.
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-bb11f8f8-3d6f-494e-8538-598a8c8a7a08 tempest-ProjectReaderTests-1144496402 None] Lock "cinder-bb412f0d-c181-4381-842c-c80afb13db57-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86631) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Flow 'volume_create_manager' (166a8f26-d3eb-4859-96d4-92500b653943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f573b867-2cef-4af1-bead-a3607b9d04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f573b867-2cef-4af1-bead-a3607b9d04ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407474735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe2703-74b9-4635-9cf5-be27626f595e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a1029f6d6842cf873b7c7c4cb41c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:06Z,use_quota=True,user_id='7b97211c8beb4b99968b2eb22a86da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57894be-584a-4639-9e00-7279e6b63361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57894be-584a-4639-9e00-7279e6b63361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57460f21-e39a-49e0-99c5-5a926e66e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57460f21-e39a-49e0-99c5-5a926e66e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafe2703-74b9-4635-9cf5-be27626f595e', 'volume_name': 'volume-dafe2703-74b9-4635-9cf5-be27626f595e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5beea9-7565-450d-b28c-4b6932eea4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5beea9-7565-450d-b28c-4b6932eea4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e004e7-1c60-427b-b826-a2cad2d36854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:05 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Volume dafe2703-74b9-4635-9cf5-be27626f595e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafe2703-74b9-4635-9cf5-be27626f595e', 'volume_size': 1}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7857f514faa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-22T22:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407474735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe2703-74b9-4635-9cf5-be27626f595e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a1029f6d6842cf873b7c7c4cb41c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:06Z,use_quota=True,user_id='7b97211c8beb4b99968b2eb22a86da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccda59e7-0012-4a23-a9af-30740d346700),volume_type_id=ccda59e7-0012-4a23-a9af-30740d346700)}" {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.remotefs [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Creating volume dafe2703-74b9-4635-9cf5-be27626f595e {{(pid=86631) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Selected osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a as target Quobyte volume. {{(pid=86631) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 23 00:37:05 devstack cinder-volume[86631]: INFO cinder.volume.drivers.remotefs [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] casted to osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a
Sep 23 00:37:05 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e 1073741824 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:05 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e 1073741824
Sep 23 00:37:05 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:06 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e 1073741824" returned: 0 in 0.463s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:06 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e
Sep 23 00:37:06 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:06 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e" returned: 0 in 0.293s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'} {{(pid=86631) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e004e7-1c60-427b-b826-a2cad2d36854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafe2703-74b9-4635-9cf5-be27626f595e', 'volume_size': 1}' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a898e60-07fa-4f3f-9491-060e9878feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 23 00:37:06 devstack cinder-volume[86631]: INFO cinder.volume.flows.manager.create_volume [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Volume volume-dafe2703-74b9-4635-9cf5-be27626f595e (dafe2703-74b9-4635-9cf5-be27626f595e): created successfully
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a898e60-07fa-4f3f-9491-060e9878feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86631) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 23 00:37:06 devstack cinder-volume[86631]: DEBUG cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Flow 'volume_create_manager' (166a8f26-d3eb-4859-96d4-92500b653943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86631) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 23 00:37:06 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-fc9300eb-34ac-4afb-b3cb-1105dbd88851 tempest-ProjectReaderTests-1144496402 None] Created volume successfully.
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Acquiring lock "cinder-dafe2703-74b9-4635-9cf5-be27626f595e-delete_volume" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "cinder-dafe2703-74b9-4635-9cf5-be27626f595e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Acquiring lock "cinder-quobyte-dafe2703-74b9-4635-9cf5-be27626f595e" by "delete_volume" {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "cinder-quobyte-dafe2703-74b9-4635-9cf5-be27626f595e" acquired by "delete_volume" :: waited 0.020s {{(pid=86631) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo.privsep.daemon [-] privsep: reply[12432a3c-14b8-4f90-afce-44dfa8f0cbbc]: (4, 'qcow2') {{(pid=88658) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:08 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e
Sep 23 00:37:08 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:08 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e" returned: 0 in 0.386s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:08 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e
Sep 23 00:37:08 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:08 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08/volume-dafe2703-74b9-4635-9cf5-be27626f595e" returned: 0 in 0.286s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "cinder-quobyte-dafe2703-74b9-4635-9cf5-be27626f595e" released by "delete_volume" :: held 0.727s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.quota [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Created reservations ['f29b31de-9158-40c2-9c97-4e21ae56fd58', 'aa68c9f6-47a9-4b65-8d5b-c81a99450b21', 'd9a89be3-a84a-4fdb-a69b-47b149ab5538', 'ec5bd6d1-b001-4ef8-9b02-7c6d9c72f59c'] {{(pid=86631) reserve /opt/stack/cinder/cinder/quota.py:763}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a': None} {{(pid=86631) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG cinder.volume.drivers.quobyte [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3649aa6e-cbc5-4764-8386-1c7fbf8b872a'] {{(pid=86631) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.lockutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86631) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 23 00:37:08 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08 {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 23 00:37:09 devstack sudo[108583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08
Sep 23 00:37:09 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 00:37:09 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root
Sep 23 00:37:09 devstack cinder-volume[86631]: DEBUG oslo_concurrency.processutils [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/faec9bfcb3e1c8110a1a7bfc47764f08" returned: 0 in 0.305s {{(pid=86631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 23 00:37:09 devstack cinder-volume[86631]: DEBUG cinder.manager [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Notifying Schedulers of capabilities ... {{(pid=86631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 23 00:37:09 devstack cinder-volume[86631]: INFO cinder.volume.manager [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Deleted volume successfully.
Sep 23 00:37:09 devstack cinder-volume[86631]: DEBUG cinder.coordination [None req-5c8e9e1f-aaa0-4bcb-92f9-278ddd3a372b tempest-ProjectReaderTests-1144496402 None] Lock "cinder-dafe2703-74b9-4635-9cf5-be27626f595e-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86631) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 23 00:37:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 23 00:37:21 devstack cinder-volume[86631]: DEBUG dbcounter [-] [86631] Writing DB stats cinder:UPDATE=21,cinder:DELETE=2,cinder:SELECT=12,cinder:INSERT=6 {{(pid=86631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}